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ABSTRACT 

This six-author study highlights the most sigr.i icant 
attributes of Computer Assisted Instruction (CAI) and explains the 
techniques of authoring CAI lessons in political science. Fourth in a 
series of Instructional Resource Monographs, the volume has the 
objective to inform political science teachers and students about 
what CAI has to offer on a range of topics, including political 
philosophy and political behavior. The volume is divided into two 
sections. Section I concerns theory and deals with the capabilities 
and problems of CAI in general. It is divided into three chapters: 
"The Computer as an Aid to Effective Teaching;" "CAI: What's in It 
for Me?;'- and "Authoring Made Easier; How CAI Packages Work." Section 
II ceals with CAI practice and presents three experimental examples 
of CAI in political science. It includes these chap':ers: "Playing 
Politics: Reflections on an Experiment in Computer-Based Education;" 
"Computer-Assisted Instruction in Political Philosophy;" and 
"Teaching Principles and Methods with CAT." A guide to selected 
continuing sources of information on CAI is included. (Author/DB) 
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Foreword 



Among ihc major acliviljes of ihc American Polilicai Science Associa- 
tion, the publication of the American Political Science Rei^iew and the 
Annual Meeting provide for exchange of information about research. 
Other major activities aim to adapt research to teaching needs, particularly 
at the undergraduate level. 

Since the Association's establishment in 1904, there has always been a 
committee concerned with undergraduate education and, in each decade, 
an education committee has issued a report recommending instructional 
goals and strategies. Today, we have a different concept of useful 
educational activity; the Association is helping prepare instructional 
materials that can be utilized by teachers and students. The regional 
seminars for college teachers in the 1960*s supported by a grant from the 
Ford Foundation, were a notable first effort of this sort. The seminars 
helped teachers locate and use new sources of course materials and 
different methods of instruction. Several hundred political scientists 
participated in these seminars. 

At the end of 1972, with the support of a grant from the National 
Science Foundation, the Association established a Division of Educational 
Affairs and began to develop publications providing teachers and students 
with instructional guides and useful materials.DE/1 NEWS for Teachers of 
Political Science, a newspaper received by all Association members; 
SETUPS, that are student learning materials prepared by faculty in a 
workshop hosted by the Inter-University Consortium for Political Re- 
search; and a Bulletin for undergraduates on Careers and the Study of 
Political Science are the initial publications. 

Computer technology has become an important aid for many political 
scientists in their research ar.d teaching- The faculty in approximately 
four-fifths of the departments offering political science courses in 
four-year institutions have access to computers for undergraduate educa- 
tion. A considerable proportion of these faculty develop and/or use 
computer related instructional materials. Many of these materials arc data 
analysis exercises or simulations that introduce students to recent research 
and quantitative methods of analysis. The Supplementary Empirical 
7'eaching L'nits in /Political Science, written, evaluated and used widely by 

O 
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facuhy ill cuiijunction witli Ww Assoualion s L'LkiLJlinn pioj'i.ini, rxiwn- 
plily such iDrnpulcr icKiU'cJ insli uclional maUM ials. 

G.uiipLikM-assislL'd InsliLRtion (CAl) provides anniliL'i and dislinciivc 
application ol compLitLM" iccfinolugy. Mere, llie Lonipiilei is used lo 
organize and present a suhjeet in a lasliion designed to .issiiie ih.tl each 
student acliieves an understanding u( problem solving skills and ol the 
concepts .md logic of analysis inherent in the suhjeLt. 

f aculty developing CAl fiave control ovei the design and pieseniation 
ol what they arc teaching. Taculty using CAl have tonsiderahle tlexihility 
in structuring their assignments and classtinie and ni assessing tf)eii 
students' learning achievements. 

These attributes, along with tfie techniques of authoring CAl lessons, 
are described by the contributors to Conjpnttr- Assisted (fistriu Uot) it) 
Political Science. Jonathati Pt)ol, the eilitor, has extended fiis scliolaiship 
in pt)hljcs and linguistics lo CAl authoring systems. And, with his 
colleagues at the State University ol New York, Stony Brook, he has 
developed a CAl progran) lor an Inlroduclot^ Course in Political Science. 
He has designed this volume, the lourth in olu series oj Instrut lional 
Resource Monogiaphs, to allow political scientists to demonstrate what 
CAl has to oMer to their collcigues and to students on a range ot topics, 
including political phik)so[ihy and political beliavior. 

Lvron M. Kirkp.itrick 
Lxccutive Dirccloi 

Americin Politic.il Science Association 
March 1976 
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Introduction 



Jonathan Pool 



A spcclLT Is haunling Wesicrn indusirial socio lies ihc spcclcr of 
compuiLTism. The mote powerfully and cfficlenlly computers contribute 
to progress, the greater grow the fears of their abuse: as components of 
atrocious weapons, tools of social control, invaders of privacy, rcinforccrs 
of socio-economic inequality, depcrsonalizers, and excuses for mental 
atrophy. One of the arenas in which the hopes for, and the fears of, 
computerization are wrestling Is education,^ as the current debate about 
pocket calculators in the elementary-school classroom reminds us. Yet 
pocket calculators will have only a rudimentary impact, compared with 
universal student and faculty access to large piogrammabic computers 
having practically unlimited memories and ever-growing libraries of 
programs. As such access becomes cheaper, more potential uses of 
computiTS in education will become economical. And more educators will 
need to choose whether and how to use computers. The papers delivered 
at the Second World Conference on Computer Education, which took 
place in September, 1975, in Marseilles,^ indicate that early illusions about 
the computer revolution that was going to envelop education in a few 
years have been revised,^ but that the process has gone far and is not 
expected to stop. 

For political scientists, this means that the original role of computers as 
tools for data analysis in quantitatively oriented courses becomes only one 
of several potential instructional roles, some of which arc not at all 
dependent on the subjccL of instruction being quantitative, or even 
empirical. Thus the question of whether and how to use computers in 
instruction becomes relevant to all teaching political scientists, not just 
those who also use computers in their research. 

Instruction that makes use of computers has been given several names: 
the most common expressions in English arc computer-assisted instruction, 
computer-assisted learning, computer-managed instruction, computer- 
based education, and computer-related instruction. In German, one sees 
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conipuliTuiiicrslui/it' Aushildifi^, coiiiinilcrgesiajc ic Unicrrichl, and so 
un. VVhal is inipurlanl lo us is not ihc dislinciions thai their several 
promoters make among such lams and the systems they represent, but ihe 
components horn which difterent systems ol instruction involving 
computers can be hiiill. 

VVhal, then, are ttie potential uses ol computers in instruction?"^ A 
broad ckbsiticati(jn might distinguish lour: preparation, management, 
insiruclion, and evaluation. In any coficrete system, the computer is likely, 
if used at all, to play more than one ot those roles. In somewhat more 
detail: 

One use ol conifuiters is in prepaiing instructional material. Computers 
can help edit, revise, and duplicLite ifistructi on al texts, and prepare 
diagrams and tabular int'ormation. 

A second use is in managing instruction. Computers can keep student 
records, give students access to guidance and instruction, and channel 
communications among students and between students and teachers.^ 

Thirdly, computers can be used in instruction itsell. They can present 
instructional material; administer drills; modify instructional materials and 
setiuences in response to student performance; conduct demonstrations, 
exercises, and games; provide bibliographic services and access to data; and 
ll'iw students compuUUional power for solving problems. 

A fourth use for computers is in evaluation. They can help evaluate 
students by giving tests, computing grades, and diagnosing needs. They can 
help students evaluate their own progress and make educational choices. 
They can be used to evaluate courses by collecting and helping analy;?c 
student opinions about them and data about student performance in them. 
And they can help us do basic research on teaching and learning by 
administering instructional experiments, whose results can also be an- 
alyzed by computer.^ 

It cannot be said, a priori, that the use of computers for any all of 
these purposes will necessarily change education in a particular way. 
Computers arc neutral, in the sense that they can be used for almost 
anything. They can make instruction more uniform than before for all 
students, or more individual i;?cd. They can reduce the diversity of 
instructional styles, or increase it. They can eliminate student influence 
over what rs taught, or give students more control than boforc. They can 
cither Increase or decrease the amount of contact between teachers and 
students, and among students themselves. They can differentially benefit 
the most successful students, or the least successful. They can make the 
preparation and conduct of courses easier for the teacher or harder. They 
can consequently require lowering standards for teacher selection, or 
raising them. And they can make education more expensive or cheaper. 
Most of us would presumably like to promote at least one of the things 
just mentioned; computers might well help.'^ 
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The dUlhors ot this hDuk luivc LcrKiiii piclcicnccs arnon^ lUv^c ^oals, 
and corKiin beliefs .iboul flow achiuvahic ihcy aie. In ^cficral, wc arc 
inlcrcslCLf in usinj^ conipuicrs lo make insliuclioji iiiorc individuali/cd, lo 
add new insif uciioiial styles lo cxisliny; rcporloiics, U) incrLMsc student 
participation in determining couise content and style, to incre.ise the 
amount of studejit-student and stULlent-teachL'r individual contact, and lo 
help the studejits who learn least easily overcome tfieir problems.^ 

We think these aims can be pursued through the use of computers 
without adding much to the total amount of time spent on instructional 
preparation, althougfi preparation will be more difficult in another sense; 
the instructor will usually have to specify instructional objectives and 
procedures more precisely, to the dej;ree that computers are being used in 
the teaching. Although we recogni/e that the economy of using computers 
in some aspects of instruction is not yet clear in comparison with tfie 
alternatives,^ we expect the ratios to keep changing to the benefit of the 
computer. And, more specifically, we expect the efficiency of produc- 
ing computer-based course material lo increa.^e faster than the efficiency 
of consuming it. Therefore we want to fiefp prepare pofitical scientists not 
just to administer programs written at a few richfy funded centers, hut 
primarify to produce programs themselves for tfieir own courses in ways 
that may welf fit into routine nstructionaf budgets. For this reason we see 
compilers as making individuaf politicaf scientists perhaps more active 
c.e; of the courses tfiey teach than tfiey have been before, aiuf thus 
eon. jng to "nstructionaf diversity.^ ^ 

fn this book, wo use the term "computer-assisted instruction," 
abbreviated ''CAf." By tfiis v/c mean instruction in which computers are 
used for one or more of the purposes fisted above, provided that these 
incfude at feast one of the purposes named under directfy instructional use 
other than the provision of bibliographical services, data access, and 
computing power. With this definition we exclude instruction in which 
computers are used onjy for the preparation of course materials, the 
managing of instruction, the evaluation of students or courses, and/or 
research on teaching and learning. We also exclude courses in which the 
only instructional use of computers is their use by students to analyze 
data. CAI, then, in our sense of the term, is still rare in politicaf science. 

This book has two sections of three chapters each, somewhat starkly 
entitled "Theory" and "Practice," respectively. Although they are related, 
neitfier section presupposes that the reader has read the ot lor, and no 
chapter is a prerequisite for any other. So that readers can move directfy 
to what interests them most, a summary of the contents is given bcfow. 

The section on "Theory" dcafs with the capabifitics and probfems of 
CAI in gcncraf. Chapter 1, "The Computer as an Aid to [ ffectivc 
Teaching," discusses the nature of learning, the aims of teaching, 
criteria for good instruction, the considerations behind decisions as to the 
role of computers in teaching, and the variabfcs that can be manipulated in 
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ilcsi^'.nin^ lornputiT -ImslhI insiiijctiini.il nuitiMi.il. CIlmiIn, Russell lUiiiis's 
tDfiics iDuUI rujt In' tK'U(Ujy;liiv ,iruilv/LHl m »i sif)\;lo cluiptiT oi vww l)i)i)k, 
Hurris is li'llin^ us whtil .vc slioukl Uiink (//>fj/// .is wi* L'\[ik)ii' tin' usl's o\ 
cotnf)UtLns in lL\u;liin^. Vot ctHiclusions i\in be intcmnl \\on^ Burris's 
antilysis. One scurns be: W vuu w.mt VDUr students to liMrn suriiclhinj; 
and write cogently tihout it, l)iJi v<>u believe it is not yDUr joh \o deline 
whtil ifiey ought to le.iifi, then CAI (i.e., the diieet use ul coniputeis to 
conduct inst.-^uclion) is not toi yen, Olfiei conipiilcr uses, howevei, may 
still be ti[i[7ropriale even to the rnos! exploralury ol courses, 

Chapter 2, "CAI: Whtit's in it tor Me?" tiddresses the ijueslion o\ 
iCtictiCi nioiivtilion. If prolesso'b who write textbooks do not iheicby win 
firotcssional tic claim, tfiey at LmsI Ctirn roytiliies. CAI technology allows 
ifie development of a simiLir s\steni ot compensation lor the auihois of 
comfHJlcr-based instructional materials, tirgues Ptiul Siegcl. He presents, as 
an example, one system iIkiI wdmIcI [irovide the necessarv incentives fof 
the production ot hIgfvi|UtiIil\ nialei iais. 

It protessors aie to produce conifui ler-based materials, not imK loi a 
larg'-' market but til so for their own classes, the etlort rei]Ui red musl l)e 
reasonable. In Chtipier 3, "Authoring Mtide i.tisier: Mow CAI Packtiges 
Work," Ptiul Siegel tind Jont>thtin l\)(jl explain ihtit pticktiged pfoguims lor 
the production of CAI nititeritils, antilogous to dalti-pr ocessing f^rogrtims, 
tire being developed to cut tiuih(j:ing lime down to modest levels. These 
packtiges ofter tidd ilicxial benotlls, too, and tire a key to wuJt ptif ticipalion 
by IcMchers in the creation of CAI rntilerttils. 

Moving trom "Theory" to "Prticlice," Section 2 fMcsenl^ ifirec ditlerenl 
extimples ol CAI in political science. The projects descrilied tiie new tind 
experimenltil, tind the authors sluire with rctiders some of their mistakes tis 
well ti^ successes. Chtipier 4, "[^laying Politics: Retlecti(jns {jn tin 
txperin)enl in G ■mpuierTBtised tductilion/' describes the experience ol 
politictil scientists in utilizing PLATO, one ot the two nitijor CAI s\siems 
being developed v/iih the help of the Ntitional Science I" t)Undtiiion. The 
instructional use for the computer in this project is to involve the student 
in rctilistic game-like exercises, where the computer simuLiles ti ptirticular 
political environment in which llie student ticis. The conipuief 's responses 
to the student's decisions are deriveil from models l)tised on avaikible 
political daia. The chapter is written by Fred S. Coombs, a principal 
developer of these simulations. 

Chapter 5 demonstrates that no sub- field ot political science is 
necc?^sarily immune from computeri/tition. In ''Computer-Assisted Instruc- 
tion in Political Philosophy," Roger D. Masters argues ()ersutisively that 
factual knowledge is indispensable for the study not cjnly of such subjects 
as American government, but also of the hislorv of political thought. Me 
shows how he has used the Dartmoutfi Time-Sharing System to help 
students improve their factual knowledge in this area. Mtislers also reveals 
the results of several 'jxperimenitil uses of the comf)uter for other 
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insiMii tiod.il , in.m.iv',1'1 i.i!. .ir)ii in.ih'i lal ptrp.)! iny; pui imst-s, 

(.'h.i[)|rr () IS ,)l>i ml "1 tMLhuu; Pi iiu iplrs .uul MciIhuIs \Mth ( Al . " 1 Ins is 
a siil^^Hi whuli, unlikf poliiiutl plulosj)phv, ilmiM^ lohu-n t(» iniiul as a 
c aDilidatc tt)i u)inpiitoi assisiaiuo. Most likt l> ilu' Urimc will si.^' niany 
si'is ol C/M inattM lals dcvi'lopcJ in nu'th(Kl()|o};\ , ospi^n iall\ lun aiisi.' a ^ivi^'ii 
set ol nialeiials miy^fil In* usi'ii in nuifscs ot scscial iJiIKmimU social 
scuMiu's. Jonatfian WnA doscril)»>'s nnr s^m los t)t k'ssofis, l)(.Mn^; di'V(.'lop(.\j at 
ttu' State Univcisitv ot New ^'oi k at Stony Utook. This tfiaptei };tvcs an 
e>ai,\)!e ot what uin he [Modnecd usin^ a ('Al packa^io oj the type 
JisiLissal in Chaf)tei llu- ihapler also y^ives sunie iJea ul tlie pi oblenis 
tfiat aiise wfien CAI pio^ianr. iu-ihI to analy/i students' verl)al 
ies[M)nses, 

The example ol CAI applications in politiLal science ^iven here aie all 
dilterLMit, yet by no means esfiaustive ot potential applications. In all three 
e\ar]iples, the eonipiitei is a sLr[)plenientary tool, not the chiet vefiicle tor 
delive y oj course content.^'* All ifiiee use interactive cuniputiny; systems 
with teiminals, rathei tfian hatch fuocessin^ systems. Many co}k7;e!. still 
have only the latter, aiuJ they ean ceilainly be useii lor CAI; hul 
inicMactive systems are much more versatile tor iTiost instructional 
purposes, aiuj are beLoniing standard equipiTieni in American fiiy^fier 
education. 

We WDuld like readers to imajjinc new combin.jtions ut tfie ideas they 
lind in tliese cfiapteis. It Masters, toi eXiimple, uses CAI to teacfi facts 
about political philosophy, while CooiTibs uses it to simulate a particular 
arena of American politics, wlial iibout reversing this? Thiit is, a piofessor 
could also use a computer lo leacfi facts about American politics, and 
another could write a program whicfi simulates a particulaf political 
philosopher (or pfiilosopfu ) for students to interact wttfi. We fiope readers 
will not only combine in new ways the elements we describe, but will also 
go past the techniques and strategies presenled fiere. Rather than seeing 
this treated as a t)ook about "flow to do it," we would like lo see the 
reaction, "If they liad t;ood results even with that, irien imagine what I 
could do! " 

The appendix to this volume is a "Cuide to Selected Continuing 
Sources of Intormation on CAI." In it. Betty Weneser sht)ws us through 
tlio array of (.>rgani/ati()ns and pul)lications in the field of instructional 
computing. Her guide will be ol use to all readers who decide to become 
active producers or users of CAI in political science of any other Held. 



FOOTNOTES 

1 . Sec, e.g., Roger E. Levi en et ill., The f: merging Tcch/io/ogy: 

Instructional U<ics ot the Computer in Higher f-Jucation (New York: 
McGraw-Hill. 1972), p. 60. 
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2. Reproduced in Computers in Educationllntormatique et enseigne- 
ment, 2 parts |vols.|, ed. 0. Lccarmcand R. Lewis (New York: American 
Elsevier, 1975), ihis colleclion of papers is likely lo be the mosl complele 
and up-io-date survey of ihe subiecl for the neM beveral years. 

3. See especially Jurg Nievergell, "Inloraciive Systems for Education 
The New Look of CAI/' in Computers ifi l.ducdtion, part 1, 465-71, pp. 
465-67. 

4. See, e.g.. Lev ion ct al., pp. 60-78. 

5. Of course, the use of eompuierb iti educaliunal adriiinistration, e.g., 
the administration of univcfsities, i>> an()!^^rr•>>ptc, not considered here. 

6. See Lawrence M. Stoiutow , "Some f ati^rs ifi t^ie Dcbign of Systems 
for Computer-Assisted Instructi-Jii," \\\ Com/n/tcr-A^i^isfea histruct/on: A 
Book of Readings, ed. Ricfiard C, Atkin>ofi and H. A. Wilson (New York: 
Academic Press, 1969), 65-93. 

7. For an irUeicsling discussion oi iiou ihe c.xpansitjn oi ihe role of 
computers in higher education relaU's lo ilie general relorm of higher 
education, see Levien et al., ch. 1 5. 

8. Cf. Peter Naur, "The Impact on Society of Computers in Educa- 
tion," in Computers in Education, part 2, 945-49. 

9. E.g., Allen L. Hammond, "Computer-Assisted Instruction: Two 
Major Demonstrations," 5c/tv;c:t^ 176 (9 June, 1972), 1 110-12. p. 1 1 10. 

10. See Felix F. Kopstein and Robert J. Seidel, "Computer-Adminis- 
tered Instruction Versus Traditic^nally Administered Instruction: Econom- 
ics," in CA/: Readings, 327-62; Levien el al., ch. 13; Daniel Alpert, "The 
PlATO IV System in Use: A Progress Report," in Computers in 
Education, part 1, 181-85, p. 183. 

11. This is important, because, as R. E. Levien notes (Levien et al., p. 
539), "Mosl instructors appear to want to retain considerable individual 
control over the conduct of their courses. . . . The implication for 
instructional computer use is that faculty members are likely to be more 
willing to adopt a use in which they retain some measure of independent 
control and ability to contribute than one in which the instructional 
process is completely predetermined." Cf. Nicvergelt, "Interactive Sys- 
tems," pp. 468, 470. 

12. This problem is, however, described only anecdotally here. See 
Wayne H. Hollzman (ed.), Computer-Assisted Instruction, Testing, and 
Guidance (New York: Harper & Row, 1970), part v. 

1 3. By contrast, Patrick Suppes has used CAI as a total replacement for 
classroom instruction in one course and says, "By taking responsibility for 
. . . two computer-based courses . . . and by offering them every term I 
have doubled my teaching load at Stanford." "Impact of Computers on 
Curriculum in the Schools and Universities," in Computers in Education, 
part 1, 1 73-79, pp. 176, 178. 

1 4. Cf. Nievergelt, "Interactive Systems," p. 466. 
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SECTION i. 
THEORY 
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Chapter 1. 
The Computer as an Aid to 
Effective Teaching 



Russell Burris 



The purpose of this chapter is to describe those variables involved in the 
teaching and learning processes which appear to be fundamental for 
computer-assisted instruction. While the focus is on various ways in which 
the computer is being, or might be, applied effectively in leaching, the 
underlying concern is with the more basic questions of instructional design 
derived from what is known and theorized about how students develop 
knowledge and skill. The observations and views presented here are those 
of an instructional psychologist with several years experience working with 
faculty members from a variety of disciplines and professions on the 
construction of new instructional designs and material?, including compu- 
ter-based approaches. While no attempt is made to dea- with the specific 
content and context of political science, this chapter is addressed to 
political scientists concerned about how the processes of learning and 
instruction are involved in the design of more effective instruction-with 
special emphasis on computer uses. For the most part the research and 
developmental work upon which this chapter is based has been done in 
association with the Consulting Group on Instructional Design and the 
Center for Research in Human Learning at the University of Minnesota. 

The computer, as well as a number of other devices and techniques 
falling under the general label of modern educational technology, offers 
the introduction of many new possibilities into educational programs. In 
fact, computer, video, audio and photographic technologies allow the 
teacher nearly unlimited choices in putting an instructional program 
together. Indeed, the possibilities are limited more by a lack of 
understanding of the processes involved in effective teaching and learning 
than by the restraints of the classroom, laboratory, textbook or 
technology. As is the case with other areas of modern society, the 
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possibilities offered by the technology tend to exceed our ability to use 
the products effectively and efficiently. Rather than dismiss or ignore the 
technology because of this lag, however, this chapter will argue that 
teachers of political science, or all teacher'^ at any level from elementary 
through post-graduate and p'ofessional, should be challenged by the 
potential usefulness of the technology for increasing teaching/learning 
effectiveness. 

Available devices allow the teacher to select and control what and how 
information is displayed to learners. Many of the realities of a field 
situation can be presented to the learner in ways which would be 
impossible without modern technologies. Further, data in a computer- 
based information bank allow even alternative realities, never observed in 
the field, to be presented to the learner. Again, the complexities and 
challenges are enormous, but it is not difficult to imagine an exciting and 
effeciive learning experience which a devoted and knowledgeable teacher 
could develop using these technologies. 

Note that mcreasing the use of this technological capability as a means 
of handling the rapidly growing volume of information within a discipline 
does not exhaust the potential of the technology to increase instructional 
effectiveness. Certainly, a teacher utilizing these technological capabilities 
will do more than present the material and expect mere recall from what 
was presented. What the teacher expects the students to do by way of 
processing, analyzing, manipulating and responding lo tliis information is 
of fundamental concern. Such expectations guide the design of drills for 
practice, of situations or simulations for experience and of problems for 
analysis and inference. 

Some Illustrative Examples 

The identification and discussion of effectiveness within computer 
based instruction is the basic purpose here. Interesting and excitin^' 
dialogues . ■ ^ . students and the materia! to be learned can be designe'J 
in a potent.. ■■ nitless number of ways not available to teachers before, 
and to some degree the dimensions of interest and excitement dcpc^^ 
upon the teacher-author's creative ability. Thus the illustrations and 
models of computer-based instructional materials included here should be 
studied mainly as a means for identifying criteria of effectiveness, rather 
than as examples to be copied or modified for teaching political science. 

The computer can display drills, exercises, information, data and 
problems at a terminal, c?sk for a response, process the student's response 
and proceed differentially through a program according to features of the 
individual student's response. Practice can be provided in applying rules, in 
drawing inferences and in solving problems. By providing immediate 
feedback to the student according to the correctness of the response, by 
providing remedial branches according to certain kinds o{ errors, by 
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tracking a student through a process of analyzing and solving a problem, 
the instructional environment approximates that of a tutor guiding a 
student through a learning sequence. Several questions relevant to 
instructional effectiveness now become important: What material or 
infcTintion is to be given to the student? How is the information to be 
disj ..^yed? In what sequence is the material to be presented? What should 
the student be asked to do in order to learn? 

German 

Consider Figure 1, showing a drill taken from a German language 
learning program in which the student is required to apply a grammatical 
rule in transforming the verb in order to achieve the indicated change in 
meaning. At the beginning of the drill the computer display illustrates the 
application of the rule, and it demonstrates how the student is to proceed 
through the drill. Next the student is given a sentence and the cue for how 

FIGURE 1. GERMAN 

An example of a student and program interaction 
taken from a German language drill 

Guien Tag Earl (n.b. The program greets each student by name because each student 
has a continuing file. Also, the program starts where that student left the program 
at the last session J 

Drill 11.1 

Die Leute sind gemutlicher gewesen. 
The people were more likable, 
would have been 

Die Leuie waren gemutticher gewesen. 
Ich habe das vergessen. 
I forgot it. 

would have forgotten 
Ich haiie das vergessen. 



11.1.1 

Die Leuie sind gleich gemutlicher gewesen. 
The people were more likable, 
would have been 

Student response: Die Leute werden gleich gemutlicher werden. 
Nein, noch einmal bitte. 

Die Leute gleich gemutlicher (n.b. The feedback repeats what was cor- 

rect but leaves blanks for what was in error.) 

Student response: werden gewesen 

Nein, noch einmal bitte. 

Die Leute gleich gemutlicher gewesen. 

Student response: waren 
Gut! 

n.1.;! 

Ich habe das ganz vergessen, 
would have forgotten 
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Student response: Ich hatte das ganz vergessen. 
Gut! 

11.1.3 

)ch habe das schon lange gewussi. 
I have known that a long tinne. 
would have known 

Student response: .a7.1 .0 (n.b. Here the student has requested an earlier drill for 
review.) 



Drill 7.1 

Maria will Heinz heiraten. 
Maria wants to marry Heinz, 
wishes 

Maria wiinscht Heinz zu heiraten. 



7.1.1 

Der Vater lassi Maricreden. 
The father lets Maria talk, 
hears 

Student response: Der Vater hbrt Maria reden. 
Gut! 

7.1.2 

Der Vater lasst Maria reden. 
sees 

Student response: .r (n.b. Here the student requests to return to where he had been in 
the program.) 



11.1.3 

Ich habe das schon lange gewusst. 
I have knov>*n that a long tinne. 
would have <nown 

Student response: Ich werde das schon lange gewusst haben. 

Nein, noch einnnal bitte. 

Ich das schon lange 

Student response: Ich werde das schon lange vergisst. 

Nein, noch einnnal bitte. 

Ich das schon lange 

Student response: Ich werde das schon lange gewusst. 

Nein, noch einnnal bitte. 

Ich das Jchon lange gewusst. 

Student response: hatt 

Die richtige Antwort 1st: 

Ich hatte das schon lange gewusst. 

11.1.4 

Sie sind zu dem Gepackwagen gelaufen. 
They ran to the baggage car. 
would have run 

Student response: .o 
Auf Wiedersehen Earl. 



©University of Minnesota 

Author: Professor Cecil Wood, Departnnent of Gernnan, University of Minnesota 
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it is to be transformed. The student, then, types the sentence with the rule 
applied. When an error is made, the feedback is immediate, and the 
student cannot proceed to the next sentence until the error is corrected. 
As this illustration shows, the computer provides the answer if the student 
is not correct within four attenipts. Had this student not produced a 
correct answer for four consecutive sentences, the program would return 
to the beginning of the drill. At that point the student would be told to 
sign off and to study the rule as described in the text again before 
returning to the computer-based drill. Note that in processing the student's 
response the computer feeds back everything that was correct, but it leaves 
blanks for the word or words that were incorrect. This particular program 
will allow the student to ju rip ahead to the next drill of a grammatical rule 
at any time five consecutive sentences are correct on the first attempt. 
Otherwise, the student must continue to practice for all the sentences in 
the drill-approximately 35 sentences per drill. 

In this pariicular German program there are 176 drills; each is based 
upon a grammatical rule to be practiced or ? review of the rules introduced 
to that point in the program; about every tenth drill is a review drill. These 
drills are derived from a linguistic analysis of German which identified 
some of the transformations and manipulations making up the grammar of 
the language. Each drill, then, provides practice in making these 
grammatical manipulations. In addition to the periodic reviews there are 
diagnostic tests which on the basis of errors made may suggest that 
students review a drill or several drills practiced earlier. Further, a report is 
given to the teacher, about every week, which indicates how far in the 
program h student has progressed, what difficulties (errors) each 
studen: ad and what drills have caused difficulties (errors) for several 
or many students. 

It should be emphasized that this use of the computer is for drill and 
practice in the application of German grammatical rules. !t is only one 
component of a more comprehensive language instruction program which 
includes, in addition^ a grammatical text, a reading text, video tapes 
displaying the language in different social contexts and classroom exercises 
in writing, speaking and listening. 

The computer-based drills are not designed to teach the entire German 
language, but an important part of what needs to be learned in order "to 
know" the language-namely. the grammar. Learning the rules by which 
structures are transformed and manipulated to perceive or transmit 
meaning, for example, the rules for changing 

"The boy hit the ball." 

to 

"The ball was hit by the boy." or 
"Did the boy hit the ball?" or 
"Will the boy hit the ball?" or 
"The boy will hit the balL" 
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rather than 

"The boy was hit by the ball." or 

"Did hit the boy the ball?" or 

"Will the ball the boy hit?" or 

"The boy the ball will hit." 
make up a fundamental and necessary part of learning ^h/^ '^ng^^f- 
Merely knowing a vocabulary list which includes boy, ball, hit, 
etc is not sufficient for perceiving or transmitting the various meanings 
contained in the example sentences. At other places in the program the 
student is given vocabulary drills, but learning to transform and manipu- 
late this vocabulary is a more difficult and a more fundamental aspect of 
"knowing the language" than is knowing particular vocabulary items. 

In summarizing this example from language learning let us recaM the 
Questions which were presented as important considerations in judging 
instructional effectiveness, namely: What material or information is to be 
dven to the student? How is the information to be displayed? In what 
sequence is the material to be presented? What should the student be 

asked to do? . , , . ,i,„ 

What is presente^ to the student for learning in this case are the 
grammatical manipulations which were identified as a necessary and 
fundamental aspect of what is to be learned, that is, what distinguishes one 
who "knows" from one wt 'oes "not know." Among the several aspects 



which were identified as .esult of this analysis, 176 gramma ica! 
manipulations were seen as fundamental both in perceiving and in 
generating meaningful utterances. Further, the need to make these 
manipulations in different perceiving and generating contexts was clear. A 
. . f„. ^;,„uv,;n„ ,„h-,r i<; to hi- learned was observed to be 



manipulations in dittereni perceivms anu s^-..^.. ......6 

variety of ways for displaying what is to be learned was observed to be 
necessary therefore, a text, video- and audio-tapes, writing and speaking 
assignments, and computer-based drills were considered different, yet 
appropriate ways. Also, it was obvious that some manipulations are more 
complex than others and that learning many of the more complex ones 
depends on a prior learning of the simpler manipulations. Hence, the 
manipulations were sequenced in order to achieve pedagogical effective- 
ness In addition, it seems reasonable to have the student practice the 
manipulations before expecting grammatical competence in realistic 
writing and speaking environments. Therefore, practice on the computei- 
based drills was scheduled p-ior to any expectation of perception or 
generation in other contexts. Finally, in deciding what the student should 
do in Older to learn, it was clear that the student had to practice applying 
the gram-.atical rules in many sentences and in many contexts. The 
computer-based drills were designed so that the student was required to 
generate sentences applying the grammatical rules in order to achieve 
meaningful utterances. Obviously, to travel on a train or to order a meal it 
is necessary to know particular vocabulary items in a target language but 
to communicate meaningfully in these contexts it is necessary first of all, 
to be able to manipulate the items in appropriately grammatical ways. 
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Law 



Before drawing implications for using the computer lor teaching 
political science, let us turn to an example taken from legal education. 
Figure 2 illustrates a dialogue between a freshman law student and a 
computer program designed as an aid in teaching the rules of evidence. 
Within the course uf instruction students use the computer-based exercise 
after reading the text and case book in which the rules of evidence are 
described and illustrated. The computer-based exercise provides an 
opportunity for the student to practice applications, i.e. manipulations, of 

FIGURE 2. A PROBLEM IN EVIDENCE 

An example of a student and program interaction selected from 
an exercise in applying the rules of evidence for law students 

In April 1971, an automobile driven by Defendant collicied with an yutomobHe 
driven by Plaintiff. Two months later Plaintiff filed a complaint tn Federyl District 
Court for the District of Frasor alleging that he had been injured by Defendant's negli- 
gent operation and/or maintenanrc of Defendant's motor vehicle, and demanding 
trial by jury. In his answer. Defendant denied negligence, alleged that he did not have 
sufficient information to form a belief about Plaintiff's injury , cind raised the affirma- 
tive defense of contributory negligence. 

You are the judge m the case of Plaintiff v. Defendant. At the pre-trial conference, 
you learn that at trial the position of the parties on the issues of fwc! will be as 
follows: 

Plaintiff will claim that Defendant was negligent because ho operated his vehicle 
at excessive speed (35 m.p.h. m a 20 m.p.h. zone), because he knowmgly lirove a ciu 
with dangerously bad brakes, because he did not keep a proper lookout, and because 
he ran a red light immediately prior to the collision. 

Defendant will claim that he was traveling at a reasonable speed (20 m.p.h.); that 
the red light v^as out of order; that he went through the intersection after being sig- 
naled to do so by a pohce officer; that his brakes were in proper repair; and that 
Plaintiff ignored the police officer's warning not to proceed through the intersection. 

You will be asked to rule on the objections m these exercises by indicating 
whether evidence is admissable. For most objections you will be asked to justify your 
ruling. 

Plaintiffs lawyer has called Plaintiff as his first witness. He is now m the middle of 
his dirpct examination of his client: 

Q. What happened then? 

A. i walked over to the sidewalk. 

Q. Did you have any conversation with anyone there? 
A. Yes, John Jones Talked to me. 

Q. How long after the accident did this conversation take place? 

A. About half an hour. 

Q. What did Mr. Jones say? Objection 1 

A. "I saw that nut ruri the light just before the accident." 

(Sustain or overrule the objection) 

Student response: Sustained 

You have ruled that the evidence is inadmissible. What are your grounds for ex- 
cluding this evidence? 

Student response: Best evidence rule 

Wrong. The best evidence rule does not apply to spoken statements. "The only 
actual rule that the 'best evidence' phrase denotes today is the rule requiring the pro- 
duction of the original writing." McCormick on evidence, section 229 (2nd ed. 1971 ). 
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Student response: Hearsay 

Correct. The lawyer's question sought to elicit testimony about a declcration 
made out of court, which would be used as evidence of the truth of the matter de- 
clared. Hence, the testimony sought was ciearly hearsay. Plaintiff's lawyer made no 
showing that the testimony would fall under any exception to the hearsay rule. 

(nrh. This illustration skips to a middle point in the program in order to sho^v more 
complex problems.) 

Plaintiff's lawyer continues his direct examination of passenger. 

Q. Were you at the Acme Garage with Defendant earlier in the day? 
A. Yes. 

Q. Did the garage owner have any conversation with Defendant? 
A. Yes. 

Q. What did he say? Objection 13 

A. "We can't fix your brakes, so I'll give you a refund on what you paid me." (Note: 
Plaintiff's lawyer has previously introduced evidence sufficient to prove that the 
garage owner died in an accident three hours after he made the foregoing state- 
ment.) 

Student response: Overruled 

You have ruled that the evidence is admissible. Why shouldn't this evidence be ex- 
cluded under the hearsay rule? 

Student response: It falls under the unavailable witness exception. 

Wrong. There is no such thing as an "unavailable w-tdcss" exception. See Field 
and Kaplan, p. 88. Hearsay evidence does not become admissible merely because the 
out-of-court declarant is not available to testify in courts. The unavailability of the 
declarant is a necessary condition for the application of some of the exceptions to the 
hearsay rule, such as the declaration against interest exception (Field and Kaplan, p. 
89), but unavailability per se does not make hearsay evidence admissible. 
(n,br For certain incorrect answers diagnostic feedback is given and references madeJ 
Student response: It falls under the declarations against interest exception. 

Correct. The garage owner's statement was against his pecuniary interest. (Push 
"e" if you are concerned because the statement seems to have been in the garage 
owner's business interest when made.) 

Plaintiff's lawyer continues his direct examination of passenger: 

Q. What was the general mechanical condition of Defendant's car? Objection 14 
A. Very poor. 

Student response: Sustained 

You have ruled that the evidence is inadmissible. What are your grounds for ex- 
cluding this evidence? 

Student response: Hint (n.b. The student has requested a hint before proceeding.) 

Objection 14: Hint: It would be helpful to the jury if the witness was more spe- 
cific about what was wrong with the car. 

Student response: Asks for opinion 

Correct. The question calls for a very general opinion about the mechanical con- 
dition of Defendant's car. And the passenger has not been shown to have any special 
mechanical expertise. The Passenger should be asked to describe specific mechanical 
problems, e.g., the wheels were wobbly, the brake pedal had to be pushed all the way 
to the floor before the car woula stop, etc. 

©University of Minnesota 

Author; Professor Roger Park, Law School, University of Minnesota 
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the rules. The computer program gives problems within a r jalistic context, 
and the student is required to solve each problem by applying the correct 
rule. 

For the law student, knowing the rules of evidence involves more than 
naming and defining the rule. The law student must know when and how 
the rules may be applied correctly. Learning the rules of evidence is, in a 
sense, similar to learning grammatical manipuiaiiur.3 in the language case. 
That is, knowing the rules of evidence requires the ability to process 
courtroom proceedings in terms of what is objectionable and admissable 
according to the rules o*" irrelevancy, best evidence, leading question, 
hearsay, exceptions, etc. Since "knowing" or "thinking as a lawyer" 
requires more than the ability to recall or recognize facts, principles or 
other elements within the law, students need practice manipulating a 
knowledge structure lo process new data and information in ways which 
are appropriate for a lawyer. The computer provides practice making these 
manipulations in a setting which could not be duplicated with a textbook 
or in a classroom; and, as we shall discuss shortly, the dialogue between 
the student and the program illustrates a number of features which an 
analysis suggests are critical for effective instruction. 

Medicine 

An example taken from an advanced clinical level in medical education 
is offered in Figure 3. This program is one of several designed for medical 
students in their final year, for residents in pediatrics and for practicing 
physicians in continuing education programs. In this example a problem is 
set in a realistic environment so that problem-solving skills can be 
pracliced-and monitored and studied. That is, prior knowledge and 
experience in physiology, biochemistry, pathology, clinical medicine, etc., 
is assumed; practice is provided in applying or transferring that knowledge 
to une of an infinite, or near-infinite, set of possible cases. The student 
works on a larger number of cases than would be possible in ifre clinic; 
and, further, the instructor has control over the nature of the problems the 
student works through. These medical cases are not a replacement for 
clinical ward experience-they are viewed as supplementary aids. But each 
computer-based case takes only about two hours to work through, about 
one-lenth the time the analogous ward experience would require. 



FIGURE 3. PEDIATRIC CARDIOLOGY 

An example of a student-program interaction selected from an 
exercise in clinical pediatric cardiology for advanced medical students 

You are a pediatric intern in an intensive care unit of a university teaching hospi- 
tal. It is 10:30 p.m. of a long day, and you have not yet had an opportunity to have 
dinner. A seven day old infant from Frozen Falls, Mmnesota, is admitted. He is ac- 
companied by an ambulance driver; his father is in admissions and his mother is at 
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FIGURE 3. MEDICINE (continued) 



home. A hastily scribbled note from the family physician indicates the child has eaten 
poorly for two days and looks ill. He is being referred for further care. 

The child is in an isolette; oxygen is being given and monitoring equipment has 
been attached by the nurse. In the emergency room, an intra-arterial catheter was 
placed by the pediatric resident in the emergenc\- room, and an intravenous solution 
of 10% D/W started. 

You would (choose one): 

1 . Examine infant 

2. Obtain laboratory data 
5. Go to dinner 

Phone one of the following for historical information or consultation. Each phone 
call will take about 1 5 mirutes. 

4. Private physician 

5. Mother 

6. Father in admissions 

7. Consultant 

G. Symptomatic management 

Student response: 1 

Physical examination. You would now be especially interested to check: 

1. blood pressure in arm 10. lungs 

2. blood pressure in leg 11. heart 

3. pulse rate 12. abdomen 

4. respiratory rate 13. umbilicus 

5. pulse amplitude 14. genitalia 

6. skin color 15. extremities 

7. character of respiration 16. neurological 

8. facies 17. done 

9. thorax 

Student response: 1 , 2, 3, 4, 6, 10, 15 

1. blood pressure in arm— 30 TiLsh 

2. blood pressure in tsg— 30 flush 

3. pulse rate~-168/min. 

4. respiratory rate— 70/min 

6. skin color— slightly delayed capillary fill; mild cyanosis about mouth, hands and 
feet 

10. lungs— clear 

15. extremities— symmetrical 

You would now: 

1 . Examine infant 

2. Obtain laboratory data 

3. Go to dinner 

Phone one of the following for historical information or consultation. Each phone 
call will take about 1 5 minutes. 

4. Private physician 

5. Mother 

6. Father in admissions 

7. Consultant 

8. Symptomatic management 

Student response: 2 

Laboratory data: You would now order (select as many tests as you consider 
necessary) : 

1. CBC 4. pC02 

2. U/A 5. pH 

3. p02 6. Na+ 
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FIGURE 3. MEDICINE (continued) 



7. 


K+ 


15. 


X-ray, abdonnen 


8. 


Cl- 


16. 


X-ray, skull 


9. 


C02 


17. 


Blood culture 


10. 


Blood sugar 


18. 


Urine culture 


11. 


Bilirubin 


19. 


Lunnbar puricture 


12. 


PT 


20. 


Ca++ 


13. 


Obtain EKG 


21. 


PTT 


14. 


X-ray, chest 


22. 


Done 



Student response: 1 , 2, 5, 1 1 . 1 3 

1. CBC-Hbg = 15; WBC = 12,500: P-40; L-55 

2. U/A-Clear; pH=5.5; sp.gr. = 1.010 
5. pH-7.1 

11. B!lirubin-2S 

13. Obtain EKG-axis +150; PR = 10; P wave, okay 
You would now: 

1 . Exannine infant 

2. Obtain laboratory data 

3. Go to dinner 

Phone one of the following for historical infornnation or consultation. Each phone 
will take about 1 5 nninutes. 

4. Private physician 

5. Mother 

6. Father in adnnissions 

7. Consultant 

8. Synnptonnai'ic nnanagennent 

Studen t response: 4 

Call private physician. It took you 15 nninutes to reach the physician. He sounds a 
little sleepy and a little hostile. You would be particularly interested to inquire about: 



1. 


age of parents 


9. 


what symptoms appeared 


2. 


nnother's health 


10. 


what were your physical findings 


3. 


other pregnancies 


11. 


any medications for the patient 


4. 


nnother's pregnancy 


12. 


any illness in community 


5. 


medications during p.'^egnancy 


13. 


mother's blood type 


6. 


delivery 


14. 


other family history 


7. 


neonatal course 


15. 


done 


8. 


when did first synnptonns appear 







Student response: 8, 9, 10 



8. when did symptoms first appear— at six days of age 

9. what symptoms appeared-mother said infant breathing rapidly and not nursing 
well 

10. what were your physical findings-the kid was breathing fast and looked very 
sick, so I sent him on down 

It is now 45 minutes since the patient has been admitted. Your next stpp is: 

1 . Examine infant 

2. Obtain laboratory data 

3. Go to dinner 

Phone one of the following for historical information or consultation. Each phone 
call will take about 15 minutes. 

4. Private physician 

5. Mother 

6. Father in admissions 

7. Consultant 

8. Symptomatic management 

Student response: 1 
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Physical exaininaiion. You ^'.ould be especially inieresied lo check (select as many as 
you consider especially periineni): 

1. blood pressure in arnn 

2. blood pressure in leg 

3. pulse rale 

4. respiratory rate 

5. pulse amplitude 

6. skin color 

7. character of respiration 

8. factes 

9. thorax 

Student response: 1 , 2, 3, 4, 6, 1 0 

1 . blood pressure in arm— unobtainable 

2. blood pressure in leg— unobtainable 

3. pulse rate— 1 70/min. 

4. respiratory rate— 80/mi n. 
6. skin color— mottled; poor capillary fill 

10. lungs— clear 

Your next step would be: 

1 . Obtain lab data 

2. Do exchange transfusion 

3. Give Digoxin 0.05 mg/kg Idigitalizing dose) 

4. Give Lasix 1 mg/kg 

5. GiveTHAM 

6. Give heparin 

7. Order lab data and start therapy with Digoxin 0.05 mg/kg (digitalizing dose) 
Student response: 3 

©University of Minnesota 

Author: Professor James MoHer, M.D., Medicai School, University of Minnesota 

In addition to providing the medical student with a realistic problem- 
solving situation, the computer program also monitors and records what 
information the student asks for, the sequence in which it is asked for and 
what treatment decisions are made. Analyses are made of each student's 
record of going through the problem for two purposes: to provide 
feedback to the student about his/her problem-solving skills and strategies 
and to do research on what distinguishes effective, or "expert," clinical 
skills and strategies. 

These three CAI programs were selected from among more than twenty 
with which the author of this chapter has been directly involved in 
development and implementation. The three as well as the others have 
demonstrated a level of effectiveness across several dimensions. They have 
not been selected as illustrations of the most innovative or as examples of 
the most advanced state of the CAI art; but, rather, their selection was 
based on certain diversities among them which might help us discern the 
fundamental factors of effective instructional design in CAI. 

What is it, then, that makes instructional programs, generally~and CAI, 
specifically-effective? What characterizes a learner's successful achieve- 



10. lungs 

1 1 . heart 

12. abdomen 

1 3. umbilicus 

14. genitalia 

15. extremities 

16. neurological 

17. done 



26 



Computer as Aid to Effective Teaching 21 



ment of an appropriate level of performance? What is il a student ''knows" 
when we are willing to say he/she "knows?" The next section of this 
chapter discusses the elements and characteristics of effective instructional 
programs within a frame of reference developed to aid program analysis. 
While the framework itself has not been derived from a particular learning 
theory, it is intended to present the important variables in a useful manner 
for teachers considering the use of computers for improving instruction. 

A Framework for Analyzing Instructional Programs 

Goals of Instruction 

Any teacher knows the necessity of having goals for an instructional 
program, a course, or units of a course, all within the setting of a 
meaningful curriculum. In a careful consideration of goals, however, 
several important issues arise which have to do with structur-ng the subject 
matter to be learned and with evaluating the performance of learners. 

What Is to be learned. Perhaps the fundamental issue to be faced is the 
question of how well the teacher can describe, or at least recognize, the 
distinguishing features of the performance of those who attain an 
appropriate level of knowledge and skill. That is, the teacher must be able 
to describe, to some level, those features of the performance of an 
individual who "knows" that distinguish that performance from one who 
"does not know." Inherent such a question are the considerations of 
knowledge structure and of performance criteria. As valuable as intuitions, 
historical precedent and texi outlines are to a course design, these may or 
may not correlate highly vith what can be derived from a systematic 
analysis of what is meant by "knowing" in a specific context. 

For example, most good teachers and good instructional programs 
clearly reflect that "knowing" is more than the ability to recall or to 
recognize the facts, principles and other elements of a knowledge area. 
Also, there is a further recognition that "knowing" is more than fitting 
these facts, principles and elements top^the: in a well-organized structure 
which is shared by those knov'!.:Jgeable in the subject matter. To be sure, 
these aspects are part or "knowing." But beyond these, there is an 
awareness that an adequate description of "knowing" must also account 
for how a knowledge structure is manipulated and how new data are 
processed within that structure in order to solve problems or to otherwise 
perform appropriately. In short, effective instructional designs recognize 
the distinctive nature of the rules or skills necessary for processing and 
manipulating information relevant to the subject matter.-^ 

These points can be illustrated also in the "subject matter as language" 
metaphor implied in the discussion of the CAI programs presented earlier 
in this chapter. If one thinks of the knowledge and skills associated with 
knowing a subject matter as a "language," the facts, principles and other 
distinctive elements of that subject matter can be thought of as its 
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•'vocabulary." These eiemenis have a logical organisation which can be 
thought of as its "structure," and the rules tor transforming and 
manipulating that structure in order to process relevant data in the 
perception and generation ot an appropriate performance can be thought 
of as the "grammar" of that knowledge area. It is the grammar which 
those most knowledgeable in a subject-matter area seem to share. It is the 
grammar which seems to distinguish those who can effectively attack 
problems, who can make correct inferences and who otherv/isc can 
perform appropriately within the context of the subject matter. I have 
argued elsewhere^ for this use of grammar as a means of distinguishing 
"expertness" from the less able or novices in a knowledge area, and Mast 
uses such an approach in analyzing "what is to be learned" in art history.^ 
Colby also presents a strong argument for the use of grammars as a 
research technique in non-linguistic areas. ^ 

Glaser and Resnick make essentially the same observation.^ 

The studies we have chosen to define the field (instructional 
psychology) come from a variety of sources and only some of them 
have an explicit instructional orientation. What is especially striking, 
however, is their convergence on the analysis of performance in 
terms of the interaction between task structure variables and the 
learning and information processing capacities of the individual. 
(emphasis added) Such an emphasis seems to us to be crucial for an 
instructional psychology which seeks to explicate the conditions 
under which educationally relevant learning takes place. 

The key phrase to be noted in the Glaser and Resnick sMIciti^ .ts is 
"the interaction between task structure variables and th-. : : mr:: and 
information processing capacities." What they refer to as "td.* st;ucture 
variables" is discussed here as the facts, principles and elements--"the 
structure"- of a knowledge area, and what they refer to as "the learning 
and information processing capacities" is discussed here as the rules for 
m.inipulating the knovvledge structure- "Lhe grammar"--in the processing 
of data and information. 

Such analyses of "what is to be learned" preceded the construction of 
the three CAI programs presented in Figures 1, 2 and 3. The analyses 
helped to identify the structures and what was to be learned -z/o^ the 
media to be used for presentation. As an illustration of the fundamental 
nature of the analysis involved, it should be pointed out that designs 
similar to that of the German CAI program have been used to construct 
materials for Dutch, Swedish, Norwegian, Italian and ancient Greek at the 
University of Minnesota-ail using a common computer program. However, 
the grammar to be learned in each of the languages is diffcrent-e.g., the 
grammar of ancient Greek is quite different from that of German. 

In most subjects, the "grammar" is only partly known, even by the 
teacher. Thus, in the computer-based exercise in applying the rules of 
evidence, compr^tence at the level of a trial advocate is not required; the 
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compeience expected of the law student at this point is only at an initial 
level of manipulation. The trial advocate's ability to raise objections 
appropriately is at another level and includes more than the simple 
manipulation of rules. The same knowledge gap applies to the other 
programs constructed for legal education, viz., applying the meaning of 
intent in the law of torts, interpreting the code of professional 
responsibility, the defense function, trial practice problems, etc. Hence, 
beyond their instructional use, these programs-and especially the program 
in trial practice-are used as research instruments to continue the pursuit 
of the what-is-to-be-Iearned question. That is, the protocols of law 
students, lawyers and law teachers help identify what, how and when rules 
and principles are used; this knowledge, in turn, makes possible the 
refinement of a "symbolic grammar" for the area. 

The use of terms like "rules" and "grammar" in this discussion should 
not be taken to imply any unrealistic stability in the contexts presented to 
the student. In the pediatric cardiology program, for example, the 
situation is dynamic: the condition of the patient changes during the 
period of the student's working through the case. The program's ability to 
allow the student to ask for and process data and make treatment 
decisions, and to analyze the student's actions in light of the patient's 
changing condition, reflects an important part of the "symbolic grammar" 
in this area. 

What needs to be emphasized in these descriptions is that the 
instructional design must be based upon goals and purposes which, in turn, 
have been derived from an analysis of what is to be learned. Of course, 
many experienced teachers have developed effective programs of instruc- 
tion without having been aware of making such an analysis, but it is this 
instructional psychologist's observation that many challenges remain in 
accounting for Instructional effectiveness. It is usually the best teachers 
who recognize these challenges and continue to work for improved 
effectiveness. It is argued here that an initial step in this improvemen. is to 
establish clearer goals and purposes based upon an identification of the 
knowledge structure and of how it is manipulated In processing lelevant 
information. 

Performance criteria. Clearer goals which have been derived from such 
an analysis also describe the criteria to be used in evaluating the learners' 
performances. Performance evaluations are instructional techniques, as 
well as assessments of competency. That is, an effective instructional 
program will provide feedback to the student regularly concerning his/her 
learning progress, and it will have a means of acknowledging those who 
have "learned." Unfortunately, too few instructional programs have such 
diagnostic capabilities. 

It is of interest to note that CAI programs similar to those shown in 
Figures 2 and 3 are being used as techniques in accrediting, and 
reaccredlting, competence. Competence is used here In the (linguistic) 
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sense of generating an appropriate performance within a particular 
context. Performances, which require manipulation and processing in \ 
realistic situation, can be analyzed diagnostically, however, only to the 
degree that the goals of instruction clearly reflect what Is to be learned. 

Context. A number of references have been made to the context of 
instruction in the discussion above. A brief, but important, elaboration 
should be made here. Political science is a different subject matter from 
German, law and pediatric cardiology. An analysis of its subiect matter 
will reveal not only different facts, symbols and structure, but its rules for 
manipulating and processing that structure will be different from other 
subject matters. To continue the subject-matter-as-language metaphor-ii 
would be a reasonable expectation to find different dialects within the 
language. Different theoretical observations, different topical areas, etc., 
are bound to produce variations in the ways in which data are manipulated 
and processed. In short, the goals and purposes of the instruction must 
reflect an analysis of what is to be learned within different meaningful 
contexts. 

Instructional Sequence 

Next our frame of reference focuses on how instruction is most 
effectively and efficiently sequenced. Sequencing deals with the progres- 
sions of steps through which the instructional program "routes" the 
student. Although very little research has been directed toward the 
problem, especially as it might relate to learning and pedagogical theory, 
any experienced teacher is aware that certain sequences are more effective 
than others. Common sense suggests proceeding from the "easy" to the 
"difficult" in laying out the progression, and trial and error through 
experience provides a certain empirical base for decisions about 
sequencing. 

Although present theories are not sufficient to guide the sequencing of 
a particular course, a careful analysis of what is to be learned provides 
helpful suggestions. Such an analysis combined with continual observa- 
tions of the difficulties encountered gives a basis for decisions having to do 
with the order of presentation. Clearly, instructional effectiveness cannot 
be improved without some attention directed to questions of sequence. 

Sequencing was an important consideration in the development of the 
CAI programs illustrated in Figures 1 and 2. In the construction of the 
German language program many questions were raised dealing directly 
with sequence. Obviously, most of the grammatical manipulations could 
be placed on an easy-to-difficult continuum, but a more important 
consideration was that initial perception and generation of German 
sentences depend on an ability to do a few basic grammatical manipula- 
tions of which more complex manipulations can be treated as elaborations 
and extensions. The rules of evidence vary in complexity of interpretation, 
and the situations in which the rules are interpreted also can vary in 
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complcxily. in the evidence program, the learning task structure had to 
consider tlicse two dimensions of complexity, not just a single scale of 
"easy" to "hard." 

Learning Strategy 

The problems of relating our best notions of what must be learned to 
our best notions of what the learner must do in order to learn 
characterizes this third dimension of the frame of reference. In the absence 
of well-formulated and generally accepted theories of learning and 
pedagogy more practical considerations are required about what and how 
the learner should practice to attain the knowledge structures and the 
processing rules of complex skills. However, to the degree the criteria 
established for knowing and performing within the instructional goals 
approximate an adequate description of the needed knowledge and skill, 
the task of specifying these strategies and procedures for learning is 
simpler. 

Experienced teachers are aware, at least intuitively, of many of the 
factors related to effective learning strategies. For example, they recognize 
the necessity of active participation in learning, self-pacing, immediate 
feedback on performance, and contextual meaningfulness. Certainly, a 
physics teacher recognizes that it is possible to know Ohm's law but not 
know how to solve a circuit design problem. Similarly, it is possible to 
know the rules of evidence without being able to apply the rules 
appropriately in a courtroom situation. 

An effective program of instruction, then, must consider what and how 
different activities are to be practiced. A careful analysis of what is to be 
learned will suggest what is to be practiced. Clearly, practice is required in 
manipulating and processing the facts, principles and other elements of the 
knowledge strtjcture in appropriate ways for handling re'evanl informa- 
tion. Learning activities should include manipulation critical to knowing, 
and they should present a sufficient variety to help "internalize" the rules 
underlying the manipulations. 

Research and experience suggest that learning effectiveness increases 
when tk e learner is active, when the practice activity is self-paced, when 
feedback on the correctness of responses is given immediately and when 
the activity is meaningful to the learner. Although learning theories fail to 
provide direct guidance to the design of learning activities based on these 
suggestions, there is evidence, gathered in both laboratory and field 
situations, which supports each of these suggestions as significant 
characteristics of effective instruction. The three examples of CAI 
programs above can be seen to require practice in ways that illustrate these 
characteristics, i.e., the learner is active, the practice is self-paced, the 
feedback is immediate and a meaningful context is established. An 
important point to be made about the potential of CAI as an effective 
component in instruction is that it allows these characteristics to be 
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designed into an activity tu a degree neai'ly impossible to achieve in other 
approaches. 

Instructional Media and Modes 

As the placement of this section implies, the selection of the techniques 
and technologies follovv's the considerations of goals, sequence and 
strategy, i.e., form follows function. Effective use of the computer in 
instruction depends less on the technological capabilities of the system and 
terminals than on how the instructional design reflects a consideration of 
the more fundamental variables involved. Nevertheless, the computer 
offers unique capabilities for student and subject matter interaction which 
should appeal to most devoted teachers. 

As described elsewhere in this volume computer systems and terminals 
differ in some of the things they can do, but there are many impressive 
possibilities in any system. The student interaction with the German 
program, in Figure 1, shows several features that make significant 
contributions to effectiveness. The student must actively respond by 
applying a rule to generate a transformed sentence. The entire sentence is 
processed by tlie computer, and immediate feedback is given as to the 
correctness of the student's sentence. The system is avp'lablc to the 
student for a period of about 18 hours a day, seven days of the week. The 
computer always responds in its usual manrcr no matter how many 
students of sometimes marginal competence a'e processed each day-its 
tolerance for perform* anccs less than pcrfc.t impresses any German 
teacher. At the present time more than 400 students enrolled in German 
courses at the University of Miiincsota and at other colleges in the state 
use the program for about three to five hours a week each during the 
academic year. Evidence indicates a time-saving of approximately 40 
percent in domg the necessary practice, and performance is at a slightly 
higher level of achievement than without CAI,^ Equally impressive is the 
fact that students rate the computer as a valuable learning resource at 
about the same level as the text and second only to the teacher -recall that 
the student has an array of learning resources available, including audio 
and video tapes and players. Finally, because performance records arc 
made for individual students as well as for all students enrolled, the 
teacher-author gels feedback concerning student difficulties encountered 
in the program. By using this feedback the teacher-author is able to make 
changes which over time improve the program's effectiveness. 

Generally, the same features of the technology noted above also 
contribute to the effectiveness of the evidence and the pediatric cardiology 
programs. Some additional features in these cases should be pointed out, 
however. As shown in the evidence program, a dialogue can be established 
which approximates a tutorial interaction. Indeed, in other law programs 
in use at the present time the students are free to develop their own 
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approaches lo a problem, and feedback is j^iven as to ihe soundness ol ifie 
reasoning used in develo[)ing llieir arguments. 

The only feedback shown in the illustration of the pediatric cardiology 
program is the information the student asked for. However, at the end of 
clinical problems programmed for medicine there is a tutorial segment 
which reviews with the student the strategy he/she used, in comparison 
with an optimal strategy developed by the teacher-author. The student is 
told what information was requested without good reason (the student is 
also shown the excess laboratory charges which would have to be added to 
the patient's account) and what information was not requested which 
good practice or other information at hand would require. 

An additional feature of this irse of the computer is the possibility of 
presenting a problem-solving situation in which the student is required to 
make- decisions and bear the consequences of those decisions, for the 
medical student such a possibility is available only through some sort of 
simulation, and the computer medium provides an especially attractive 
practice environment. 

Because computer technology is still developing, additional features 
which can be expected to contribute to greater effectiveness remain on the 
horizon. Information displays will improve with better graphic capabilities 
in the terminal and with computer-controlled audio and visual presenta- 
tions at the terminal. Although such technological ca[)abilitics are 
available, they are not readily accessible to most instruction programs yet. 
But they should be available in the near future, and, because costs 
associated with this technology continue to show a decline, they should be 
available at reasonable cost. 

Again the major difficulty in selecting and using the computer as an 
instructional medium is to relate the technological capabilities to what is 
to be learned in ways which are appropriate to both aspects of the 
relationship. Certainly, the computer has considerable potential for 
improving the effectiveness of many instructional programs, but the 
possibilities tor misuse are clearly present. 

Motivation 

No teacher doubts the importance of motivation variables the next 
issue in the frame of reference- in accounting for instructional effective- 
ness. In the absence of an adequate accounting derived from motivational 
and pedagogical theories, attention needs to be focused on a numbor of 
practical considerations which clearly contribute to effectiveness. 

A major consideration has to do with the degree of similarity or 
agreement between the student's expectations and the teacher's instruc- 
tional goals. Further, arc the learning activities meaningful to the student 
in terms of these expectations? Are the student's goals derived more from 
"internalized" need or more from some externally imposed requirement, 
and to what degree do these goals relate to the student's long-term 
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objectives? Grades and other forms of evaluative feedback have some 
apparent motivational effect, and, if used properly, can mlluence 
effectiveness. 

Clearly, a teacher who strives for instructional effectiveness cannot 
afford to Ignore motivational variables in designing courses and programs. 
CAI alone may carry a ^Hawthorne effect," at least lor some students. If 
exploited wisely, it should not be considered as a negative attribute. 

Individualization 

The final construct in this frame of reference is an area of obvious 
importance in a consideration of instructional effectiveness, viz,, indi- 
vidualization. The potential contribution of CAI as a means for individual- 
izing a program of instruction is obvious. However, in spite of a number of 
intriguing possible relationships between individual differences and instruc- 
tional design supported by the research literature, there is little theory to 
guide instructional design in the use of individualization to optimize 
effectiveness. Activities which allow more individualized approaches scern 
sensible. More fundamentally, and specifically, the ability of CAI to vary 
the nature and sequence of learning activities in order to provide different 
routings and different patterns or practice should help to avoid mistakes 
resulting from the difficulty of taking known individual differences into 
account. 

Some Concluding Remarks 

Only within the past decade or so has a more concerted effort been 
directed toward the development of an instructional psychology. There arc 
complex difficulties in attempting to describe how principles of human 
learning might be applied to teaching programs. This chapter has not tried 
to deal with these complexities in a systematic way appropriate for the 
researcher, but it has tried to point out issues and questions arising from 
these com'plexities in a practical way appropriate for the teacher. Thi. 
chapter offered no easy approaches for the teacher to deal with these 
complexities in the design of instruction, but a frame of reference was 
presented which it is hoped can be useful to the teacher as an aid in 
attempts to improve instruction. The discussion thus far has dealt only 
with those variables within learner-program interaction. The author is 
moved, however, to present some issues external to this interaction which 
are more indirectly relevant to instructional design and which are 
important to a consideration of effective use of CAL 

Political scientists, as teachers in other professional and subject-matter 
areas, are under considerable pressure to make changes in the traditional 
approaches to instruction. Present practices in student selection, instruc- 
tional design, curricular arrangements, examination procedures and teach- 
ing techniques are all under this pressure. The Increasing needs of many 
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nontraditional groups tor new or modified instructional programs are the 
objects of a significant portion of (he changes being demanded. Different 
minority groups wfio, for a variety of reasons, have been excluded from 
the traditional target population of past instruction are being recognised. 
The number of men and women over twenty-five who want to return to or 
to start educational programs appears to be increasing. Many older 
individuals desire programs which will provide leisure activities or help 
meet career change desires. Legislation and other pressures are forcing 
many professioruils to return to the universities in order to update their 
knowledge and skills. Accompanying the increasing number of nontradi- 
tional students is an increasing pressure for changes and programs from 
traditional students. Among these askcd-for changes are increased field or 
clinical experience as a part of educational programs, more individualised 
or independent study alternatives, different evaluation or grading tech- 
niques and procedures, and a recognition of competencies gained outside 
the traditional course structure. Also, procedural changes are necessary in 
recognition of greater student mobility, an increasing desire to stop off 
and the possibility to provide instruction at remote sites- the open- 
university model. 

Alternative approaches to teaching and learning designed to meet these 
changing requirements are made possible to a significant degree by the 
availability of computer technology, but the challenge to the responsible 
teacher is enormous. The quality, effectiveness and success of CAI 
programs depend primarily on the support given to them by responsible 
faculty, individually and collectively, in the various disciplines. Excellence 
in new and more flexible approaches to teaching and learning can be 
attained only as these responsibilities are clearly defined and accepted by 
disciplinary faculty members. More is required than the mere introduction 
of new techniques and technologies in a variety of otherwise unchanged 
courses, and no educational technologist can supply the needed expertise. 
In political science, therefore, it is political scientists who will have to 
analyze the structures of knowledge and the criteria of performance, if 
they hope to use computers to make their teaching not just more 
fashionable, but more effective. 
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Chapter 2. 
CA I: What's in it for Me? 

Paul Siegel 



"Wc have harnessed our technology to reach the moon; we must now 
harness technology to teach our children!" So urges an invited public 
figure in a keynote address at one of the numerous national conventions of 
educators or educational support industries. The precise convention is not 
important since these words or their florid counterparts will be echoed at 
almost every gathering. What /s important is the belated confidence these 
words betray- that the newly developed technology can and should be 
used to take yet another *'giant step for mankind." And the bandwagon 
grows. 

This confidence may seem naive. Yet it has some grounds. Today few 
knowledgeable people would deny the potential of computer-assisted 
instruction. Some have compared this potential to the revolution which 
followed the introduction of mass printing. Says Patrick Suppcs, '*Justas 
books freed serious students from the tyranny of overly simple methods 
of oral recitation, so computers can free students from trie drudgery of 
doing exactly similar tasks unadjusted and untailored to their individual 
needs. One major motivation for teachers to use CAI, then, is the fact 
that it can probably help them do their job better. 

Sustained investigation into the possibilities of CAI began in the 1960's, 
and the results of experimental studies have been very promising. They 
show that, with CAI, we can have better defined instructional objectives, 
more varied and effective Instructional strategics, greater accommodation 
of individual differences, and better evaluation of the instructional 
process. Teachers, when relieved of tedious and unproductive monitoring 
of the drill and practice or tutorial situation, arc able to spend more hours 
in activities requiring personal mediation. As a result, students receive 
more precise recognition of their needs for remediation or enrichment in 
all areas, and appropriate material is provided at the proper moment. 
Valuable data on the learning process arc accumulated with the consequent 
improvement of educational techniques in the classroom as well as the CAI 
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laboratory. In short, there is generally a more productive use of the 
teacher's and student's tinu\ and a sij^niticantly higher level of achieve- 
ment on standard examinations by students using CAI when compared to 
control groups. 

For example, students enrolled at the State University of New York at 
Stony Brook in the Introductory German course and placed in the group 
which was assigned one lesson per week in the CAI laboratory did 
significantly better in reading and writing although no time was spent on 
this in class. ^ And the instructors, able to spend more time on 
conversation and dictation, raised performance levels in these areas as well. 

In describing the computer-based education system at I Ilinois/Urbana, 
Donald Bit/er states that 'The teaching versatility of a large-scale 
computer is nearly limitless."^ John Pierce in his report, Computers in 
Higher Cducal/on,'^ asserts that at least 35 percent of college under- 
graduates are enrolled in curricula in which they could make valuable use 
of computers, and an additional 40 percent are in curricula for which 
introductory computer training would be very useful. And Fred Tonge, at 
the University of California, overcomes his uncertainty and grudgingly 
accedes. "Education by computer," he admits, ''is basically a good thing. 
In fact, we may have to automate just to get the job done; there won't be 
enough teachers, or sufficient high quality instruction in problem areas. 

in spite of its promise, the recommendation that the computer be used 
as a remedy for some of the pressing problems of our over-burdened 
educational systems frequently meets with a cold reception. On the whole, 
most educators have their lives pretty well adjusted to the status quo. Most 
will probably resist any major disturbance that requires a radically new 
frame of reference. In addition, many educators have a healthy suspicion 
that faddish computerti^ation might ruin education instead of improving it. 

Adapting the System to CAI 

How, then, can the advocates of computers in education motivate 
teachers to accept them? The first thing to do is to clarify that the 
intelligent use of computers in instruction will not displace iiuman 
teachers; it will make their role more attractive instead. Rather than 
attempting to do everything by computer, we must look at the system and 
ask fundamental questions. What /5 education? How can the computer fir 
in? Some of the activities crucial to instruction can presently be 
programmed; others cannot. Care must be taken that tentative decisions 
are not implemented in rigid software, difficult to change. Given the 
flexibility of even today's hardware and software, there is no excuse for 
this to happen. We need to explore many different technologies and 
approaches. The tendency, today, to blow up small amounts of experience 
as definitive is a serious mistake. The computer should free us to try many 
instructional alternatives-not put us in an educational straight jacket. If we 
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arc j;()ing t(> Josi^n prD^rams tor a Lonslaiitly chan^'JnK st)ciciy, wo nuist 
Iciirn tt) dcsi^in prt)^ratns wfiicfi will novcr be ct)niplctcHl. Tficy rmist he 
continually cvaliiatcd and rcvisod, and instructDrs must learn to sec their 
role as an evolutional y t)ne always delerniined in part by present and 
future developments. 

Duncan Hansen and William Harvey of I lorida State University, 
Tallahassee, fiave come up witfi a prelim inaiy ^iiidc to some of the new 
ways in whicfi techers may he encourj^ed [o regard their new rt^le wfien 
aided hy computers:^ 

1. Tfie tcacfiers will perhxni much less of the intt)rmalional presentatit)n 
functions presently found ifi our classrt)t)nis. Undoubtedly, the teacher 
will become more involved in tfie manav^erial and strategy tunctions 
found in tfie sequencing and cViiluation of tfie instructitmal process. 

2. Teachers will play less of the ct)rrective role in terms of tfieir 
qLiestioning and evaluative l)ehavic)rs. This undoubtedly will offer a 
significant step forward in teacfier-stutlent rel<itionsfiips in that much of 
the negative verbal befiavior observed in classrooms will now be shifted 
to a more tiulividuali/ed and private interaction within CAl, 

3. Teachers will t)ecome more concerned with the host oi individual 
characteristics important in designing an instructional strategy; ifius, 
tfie array of instructional resources will become nH)re complex, , , . 

If history seems to disclose a pattern of workers dispossessed by macliines 
with no new roles created for them, tfiis need not and should not be the 
pattern in education. The image of tfte computer as a teacher substitute 
needs considerable revamping. 

This evolution, however, cannot be left to take place without planning. 
The behaviors characteristic o\' the modern teacher sliould be included in 
any consideration of system changes, and prt)per training provided. 
Vtirious requirements of the system can be taken into account, and efforts 
can be made to maximize ific system's cfiief output -education. 

The building of a system model should begin with some clear and 
precise statements of the expected outcomes of education. Second, the 
existing system might be analyzed to determine current teacher behavior, 
the relevance of these behaviors to the proposed system, those aspects of 
the current system which can be eliminated, and those aspects which musl 
be accounted tor in the new model. Next, the various elements which musl 
be supplied by the system in order to provide students with thai 
"hierarchy of Cc^pabililics" necessary to achieve the anticipated outcomes 
are listed.'^ Then the components of a system that can best help the 
student to acquire these capabilities is delineated, with each component-- 
teachers, non-teaching professionals, computers, etc. allocated lo ihe 
aclivilics it is best equipped lo perform. And finally, the esscnlial iraining 
programs that provide each person with the necessary skills lo perform 



39 



,M CAI: Wh.it's in ii Uu Mo 



thosL' .iLiiviliL's .issi^iu\l lo liini iiuisi (K'\l'!(>(hh1. 1 he Lh.iii};rs cm hr 
iii.uk' U'ss p.iidlul .iiul cl lii ilmii il iIk' iriiuisitr pKiiiiiin^; is dniii'. 



(A)iii|niiiM s in L\lLiL.iliofi sIidliIlI not ti'fil.iLC IlmlIilms, mui iLHL'^;aU' lIuMii 
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effeclive course materials very lime-consuming and cosily if there were no 
efficient means of aulomaiing ceriain aspects of the process. 

Standard computer programming languages are not suitable for the 
preparation of CAI lessons. They require a programming proficiency that 
course authors seldom have or desire to obtain. And the services of 
experienced programmers are usually costly. In addition, the duplication 
of effort that generally results where an author works directly with a 
programmer to produce a course contributes to the lack of cost 
effectiveness in evidence at many ambitious CAI pre jects. 

Teachers must be convinced to use CAI in the first place, and they must 
be noiivalcd to provide the raw material for lessons. To do this, it should 
not bo necessary that they become programmers. There should be a way 
for them to specify, in fairly natural language, which material is to be 
presented to the student and how it is to be presented. AH unnecessary 
obstacles to man-machine communication must be removed at the author's 
level. The power of the computer should be at ihe author's disposal, but 
the control of that power should be relatively simple. 

Fortunately, the computer makes it possible to design content- 
independent instructional procedures, which can be stored in a library for 
repeated use. Over time, more and more procedures are stored, revised 
with experience, and incorporated into easy-to-use packages, whose 
workings are described in Chapter 3. The computer's capability for routine 
collection of response data enables the curriculum designer to better 
analyze the process by which various skills are acquired. Such analysis ^an 
then be used to further optimize the learning procedure. The result is a 
commonly accessible and growing library of tested, effective instructional 
procedures each of which can be described to an author as a sequence of 
instructional events. Optimization strategies that in the past were usually 
too complex to incorporate into, or evaluate in, an instructional setting 
have been made accessible to use and investigation by the ready 
availability of many packaged procedures. This process, over a period of 
time, results in an orderly, efficient, and reasonably economic system for 
CA! course preparation. 

As more people get into the activity of designing CAI procedures for 
public use, it will be important to cultivate an awareness of the fact that 
the development and evaluation of programmed instructional procedures is 
a time-consuming, expensive proposition requiring areas of expertise that 
are multi-disciplinary. When such an investment is made, therefore, we 
should be assured that each package is as flexible as possible in its 
parameters and can be tailored to courses in many areas. And completed 
courses should be amenable to modification at nominai cost. It is also 
essential that instructional materials and authoring packages into which 
large sums of money have been invested be capable of transfer from one 
institution and system to another. 



41 



36 CAl: What's in it for Mc? 



However, for a system which supports authors in the act of creating 
CAl courseware, it is not enough to remove technical impediments from 
the production process. Positive incentives are ulso needed. The system 
must provide suitable proprietary protection v ith provision for royalty, 
thereby encouraging authors to invest their time and expertise in this 
activity. If anything, the development of computer-based learning materi- 
als requires more complex skills than does textbook writing. And, given 
the limited prestige attached to this activity, many educators write to 
make money. 

At present, CAl authors, if compensated monetarily at all, are 
compensated on a one-time basis with all materials then placed in the 
public domain, or becoming the property of the hardware distributor. 
Recently two commercial hardware manufacturers, Digital Equipment 
Corporation and Hevvlett Packard, enga\;ed in major projects to produce 
instructional units. Both of these projects relied on a lump-si'ni payment 
to the authors because of what was termed "the investment of time 
necessary to maintain records of individual sales and pay royalties 
accordingly."^ IBM relies on their lUP (Installed User Program) system to 
compensate authors. But this, too, is based on a single-payment distribu- 
tion mechanism. This situation exemplifies the present primitive state of 
the market for CAl materials and the low level of incentives for their 
production. 

Preparing a good CA! course is roughly equivalent in effort to writing a 
good textbook. Most authors are quite willing to produce textbooks at a 
10 to 15 percent royalty rate. But many gtjod authors will undoubtedly be 
lost to CAi if we do not offer them similar incentives to produce the 
material for computer-based instruction. The involvement of subject- 
matter experts in computer-assisted instruction deserves high-priority 
attention. Any CAI system is- o!i'y as good as the curriculum which it can 
place at the students' disposal. Toe best pussible hardware with light pens, 
slide projectors, audio units, and the like acts only as a vehicle to carry out 
the programs of educators. In our enthusiasm for new delivery systems, we 
must not lose sight of ihis fundamental fact. 

The technology that permits procedures which can assure auth(^rs of 
adequate protection and return for their efforts alreaJy exists on the very 
large, network-type systems supporting thous^mds of terminals simultane- 
ously. These systems, such as MULTICS now being marketed by 
Honeywell to run on its 6100-series coinputer, typically have elaborate 
operating systems with sophisticated accounting procedures and the 
required protection for proprietary inf'^rmation. Courses can be stored 
centrally on such systems and accessed anvvvliere. with the user charged on 
a per-use, per-hour, or per-course basis. 

Hovsever, recently it has become evident that we need not invoke the 
economics of giant systems to acfiieve cost-effeciiveness per terminal hour 
for CAI service. Current technology allows a \ery small computer system 
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supporting in the neighborhood of 32 terminals to compete with, and 
provide in some ways better and more reliable CAI service than, the very 
large centralized machines. These mini- and micro-computers cannot, 
unassisted, support the kind of elaborate security mechanisms needed to 
insure adequate protection of proprietary materials. Nor can they supply 
the necessary accounting procedures to guarantee royalty payments. 
Nevertheless, there is an answer which is, in some respects, even more 
lotisfactory than a well-functioning accounting system. 

The packages described in Chapter 3 would produce courseware coded 
for cassettes rather than for assembly on a centrally located direct-accei)S 
device. The small computer system would be required only to enforce the 
policy that no cassette be played through to the end more than once. This 
could be implemented in a number of ways using the same underlying 
principle. For example: 

1 . The material on each cassette is encrypted with a unique cypher which 
is also recorded on a magnetic stripe credit card associated with the 
cassette and purchased with it by the student. 

2. The system reads the appropriate cassette after the student has logged 
on using his credit card. If the cypher does not match the one on his 
cassette, the student is logged off automatically. 

3. If the cassette is positioned at the first record, and it is a legitimate first 
record (i.e. never road before), that record is changed to a special code 
which signals the system to log the student off if it is ever read-in again. 

The student purchases a kit which includes a cassette, a credit card for 
the course, and, optionally, any auxilliary materials such as a workbook. 
The price of the kit is set to recover the cost of purchasing, or leasing, the 
computer system in addition to returning a profit to the publisher, and a 
royalty to the author for each use of the course--this would surpass even 
textbook royalties based on book purchases since a book may be re-sold 
and re-read by another student. 

If the average course were to fit on two cassettes, the cost of the 
distribution materials might be less than $1. The kit, sold at a price 
comparable with a textbook ($15), could realize a $5 return for the 
publisher, and a $1 royalty for the author. The educational institution 
could receive $8 to defray system costs plus $2 for unusual operating 
expenses. These figures are, of course, only meant to convey a sense of the 
feasibility of this approach and are in no way hard and fast.^"^ 

Such cost-effective, small, dedicated, decentralized systems for delivery 
of CAI services would have a further valuable by-product: reinforcement 
of the diversity which is such an enduring part of the American 
educational credo. "There is really no single educational goal; indeed, the 
beauty of the decentralized American school system is that each ... is in 
effect a separate educational 'laboratory.' "^^ CAI systems like the one 
described could in fact help colleges and universities achieve local control 
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and autonomy with regard to the development, evaluation, and manage- 
ment of computerized educational processes. At the same time, incentives 
which are likely to attract the best among curriculum specialists can be 
offered to authors, thereby guaranteeing the development of superior 
curricular materials. And finally, once such a method of producing CAI 
materials is accepted, it will generate renewed interest among publishers 
who have the packaging, warehousing, and marketing organizations needed 
for efficient widespread distribution of curricular material. 

The eventual impact of computers on education will be enormous, as 
great as the advent of mass printing once was. Computer-based instruc- 
tional systems present one of the few means possible of fulfilling the 
growing demand for higher education while retaining the adaptability of 
such education to individual learners. Computers offer a viable technology 
which can meet effectively the crisis of numbers vs. quality in higher 
education. 
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Chapter 3, 
Authoring Made Easier: 
How CAI Packages Work 

Paul Siegel and Jonathan Pool 

Almost no-onc finds it painless to write a good textbook. It is an 
intellectual challenge to put oneself into the shoes of the learner, and it is 
even more difficult~if not impossible~to do so in such a way that the 
product will be satisfactory for many different users who learn at different 
speeds and in different ways. How formidable is the task of writing CAI 
lessons, then, in comparison with that oT writing a textbook or workbook? 

With CAI, the basic problem of bridging the teacher-student gap 
remains crucial. But the secondary problem of having to design a single set 
of materials for a heterogeneous audience is not so serious, because CAI 
lessons are not the same for all students. Since lessons can be programmed 
to alter their own content and sequence in dynamic response to student 
performance, no two students need ever go through exactly the same form 
of a CAI lesson. This enormous flexibility brings with it a new challenge 
not faced by the authors of textbooks and faced in only a rudimentary 
form bv the authors of workbooks. It is the challenge of anticipating what 
the different kinds of students will be, how they will differ in the learning 
problems they have, how their individual needs can be recognized, and 
what special treatments they can be given to help them achieve the desired 
learning goals. Chapter 1 went into these problems and suggested some 
guidelines for coping with them. 

Given the desire to respond to these challenges, how do you, the 
political science teacher, actually proceed, if you have access to interactive 
computer facilities and want to try CAI as part of your teaching 
repertoire? If appropriate CAI course material already exists, you may be 
able to obtain a copy usable at your installation. This is not very often the 
case at present, since the number of CAI sequences in political science is 
currently very small and the technology for transforming CAI programs 
among dissimilar computer systems is still primitive. We expect this 
situation to change, however, and even now the question is still worth 
asking. 
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In the most common situation, you will thus be faced with the prospect 
of writing your own materials. Let us suppose that what you want to write 
is a set of lessons or exercises designed to supplement (or perhaps replace 
one of) the modes of instruction you presently use. You will naturally 
want answers to two questions: (1) What do I have to learn in order to 
begin writing? (2) What is involved in the writing process itself? These are 
the questions to which we shall provide brief answers in this chapter. 

The job of the contemporary CAI author can be best appreciated by 
contrast with two extreme possibilities. In the most luxurious of ail 
possible worlds, the director of the campus CAI lab would say, ''Of course, 
professor. You just tell lis in your own words what you would like the 
computer to do, and either our staff will find a way to make the computer 
do it or we'll ask you to revise your request." In the leanest possible world 
still endowed with CAI, the offer would be, "You give us the program on 
tape, and we'll mount it." 

For the large majority of political science instructors with any access at 
all to CAI facilities, the former world is a thing of the past or the 
unforeseeable future, and the latter world is unrealistically dismal. The 
world of tomorrow, and of today in some colleges, is a world of packages, 
which authors will be expected to learn how to handle themselves, but 
which are incomparably easier to use than a CAI programming language. 
You are probably familiar with the existence of computer program 
packages in data processing. Most professors and students who want to 
process data wish to carry out a common procedure, such as word- 
counting, regression, or cross-tabulation, on an uncommon set of data 
which they have at hand. Packages like the General Inquirer, DATA- 
TEXT, OSIRIS, and SPSS allow them to make choices among certain sets 
of alternatives. This task can be learned and carried out quickly by 
computationally unsophisticated users. CAI packages, which have begun 
appearing relatively recently, are analogous. They make accessible a variety 
of common instructional procedures and alternatives, which users (i.e. 
authors) can apply with relative ease to their own subjects. These 
procedures are independent of subject matter, and the bulk of them are 
general enough to fulfil! learning objectives across many disciplinary 
boundaries. 

With both kinds of packages, the user selects options by submitting a 
deck of control cards for computer processing, or by answering questions 
which the packaged program asks the user through a computer terminal. In 
both cases, only commonly demanded options are offered, so the most 
idiosyncratic users must either modify their desires or, bypassing the 
package, write their own procedures. But in both cases this limitation is 
being progressively relaxed. Packages are becoming more versatile; indi- 
vidual users' special procedures are getting documented and stored in 
libraries available to other users; and jacks are getting built into more 
packages to allow users to switch from package to package or to plug in a 
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custom-made procedure where necessary, white still using the package 
where appropriate. 

We believe that this trend toward Increased versatility will continue in 
the future for CAl packages as well as data processing packages. Hence, for 
almost all political scientists, the two questions posed above can be 
translated: "What is involved in learning to use a CAj..author's package and 
in actually using it?" In the remainder of this chapter we shall try to 
answer this question both quantitatively and quaiiiatively. 

Using a CAl Package 

Quantitatively, a rough estimate is that it will take someth ng like five 
hours to learn how to use an author's package reasonably well. This can be 
done in a workshop, or by reading a manual, or through an instructional 
program. (In the latter case, you are undergoing CAl lessons on how to 
write CA! lessons.) Thereafter, an experiential estimate is that 5 to 1 0 
hours of writing are required for each hour of computerized first draft 
ready for trial use with students. Your time expenditure can be cut still 
further, although not much, by the employment of an assistant to 
translate your desires into commands acceptable to the package. On the 
other hand, a need for extensive preliminary research and model-building, 
as illustrated in Chapter 4, would raise the estimated investment of time 
greatly. When observation of the lessons in action and analysis of the 
performance data reveal the need for further editing of the lesson mateiial 
(which is normally the case), a package allows this editing to be carried out 
with roughly a proportionate amount of effort: rewriting 10% of a lesson 
takes something like 10% as long as it took to write the Lsson. This is 
because the package separates content from procedure and one portion of 
a lesson from another portion, where possible. Whatever needs to be 
modified can be, and the rest remains intact. For comparison, estimates of 
the writing effort when no package is available and the author must 
program lessons directly in a programming language range from 100 to 200 
hours of programming per hour of resulting lesson. Learning a progi am- 
ming language also takes far longer than learning to use a package, and the 
detection of all programming errors made by the author is usually 
impossible. The package, on the other hand, contains code which has been 
tested to the point where it is virtu^^lly bug-free. 

Qualitatively, the process of using a CAl package is likely to be a 
continued accommodation between what you would like to Jo and what 
you can do. Procedures which you might have liked to try out but which 
are not available may become modified, in practice, so that a packaged 
procedure can be used. At the same time, procedures that you would never 
have thought of implementing, perhaps because of their complexity, may 
be used when you see that they are available in a package. Sometimes, of 
course, this can take the form of technological infatuation, a danger which 
is equally present to the users of data-processing packages. The great range 
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of possibilities offered by packages obviously puts increased responsibility 
in the hands of the author for selecting appropriate procedures. Often you 
may want to select more than one and see how their results compare; the 
student performance recording which the package automatically provides 
will assist you in subsequent evaluation. One important qualitative 
difference between using a package and programming your own material is 
that with packages the primary effort is dedicated to developing and 
elaborating instructional strategies and textual material, while program- 
ming forces authors to spend most of their time figuring out how to get 
the machine to do what they want. Individually programmed materials 
inevitably :oniain undetected errors, which become obvious only during 
student use and require rushed remedial action. With packages, on the 
other hand, procedural errors are much rarer, and attention can be devoted 
to such problems as substantive misunderstandings. 

Packages are under continual development, but for a concrete idea 
about what can be done with them let us look at some oi' the procedures 
currently available in packaged form. 

Three Examples 

Example 1: LISTGEN. This is a procedure for varying the frequency of 
presentation of a stimulus depending on the response difficulty encoun- 
tered by the student, it can be used when there is a large set of stimuli and 
you want to be sure that each student has given the correct response once 
to each stimjius with only one try. You provide the ban k of stimuli, a 
corresponding bank of cues, and a corresponding set of correct answers. 
The stimuli night, for example, each consist of a term and a numbered set 
of possible meanings for the term. The corresponding cues might consist of 
sentences in which the terms are used. With this information, the package 
generates a CAI program which selects a working subset of approximately 
24 stimuli from the bank and presents one of them to the student. If the 
student correctly responds to the stimulus, it is removed from the working 
subset, a new stimulus from the bank joins the working subset, and the 
next stimulus in the subset is presented. If (s)he responds incorrectly, the 
cue is displayed and (s)he is given additional opportunities to respond. 
When (s)hc finally does give the correct response, the stimulus is not" 
removed f'om the working subset, but is reinserted at a position 
determined by the number of attempts the student made before getting 
the right answer. The most frequently and most badly missed terms are 
thus seen most often. When the bank has no more terms and the working 
subset is also exhausted, the lesson is terminated and a new lesson may be 
initiated which draws on another bank of items. 

Example 2: PATMATCH. Pattern matching is a teaching and testing 
technique enrployed frequently across many disciplines. Often it is used in 
its multiple-;hoice rather than its constructed-response format. For such 
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exercises, a procedure is available which considerably reduces the author's 
input relative to the number of problems generated for the student You 
merely enter a list of subfiles plus a standard instruction. A simple 
example is: 

(1) Secretary General 
General Assembly 
Security Council 
UNESCO 

(2) Office of Management and Budget 
Capitol 

Secretary of Defense 

Interstate Commerce Commission 

(3) Governor 
Lieutenant Governor 
National Guard 
Board of Regents 

(4) Mayor 
Dogcatcher 
School Board 
City Hall 

Instruction: Choose the institution that is most likely to 
belong to the same "level of government" as the first one 
given. 

The package generates a program which in turn randomly generates 
problems from these files. One such problem might be displayed as 
follows: 

Choose the institution that is most likely to belong to the 
same "level of government" as the first one given. 
Secretary of Defense 

1 . National Guard 

2. Mayor 

3. Interstate Commerce Commission 

4. Secretary General 

The student has an extremely large group of problem possibilities to work 
on until mastery of the conceptual distinction being taught here ("levels of 
government") is achieved. Thereupon, (s)he might work on a more 
difficult version of the same exercise, or on an exercise using the same 
stimuli newly ordered for a different distinction (e.g. "institutional type"). 

Example 3: CLUEGEN. This is a more versatile packaged CAI 
procedure, particularly likely to be of use in non-quantitative applications. 
The basic strategy of this procedure is the following: 
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1. present instructions (directions, learning objective, examples of ex- 
pected performance) 

2. present stimulus (question, problem, etc.) 

3. request response 

4. process response (compare with answer set and determine closeness of 
match) 

5. determine appropriate feedback and subsequent sequence of remaining 
stimuli 

6. present next stimulus according to the determination made in 5 above 

7. continue from point i 

Typically, you provide the package with a bank of clues to be displayed to 
the student in sequence as the student gives incorrect responses to a 
particular question or problem. When the last clue has been displayed and 
the student still gives the wrong answer, the computer displays the correct 
answer. After the correct answer has been given by either the student or 
the computer, the lesson proceeds to the next item. 

This basic pattern is subject to numerous modifications. You can 
determine where on the screen the question or problem appears (if the 
terminal displays output on a screen rather than paper). You can 
determine whether the clues overwrite each other or whether each clue 
appears below the previous one leaving it intact. You may provide for 
more than one correct answer, any one of which will be accepted as such. 
You can also specify temporary right answers, i.e. answers that will be 
considered correct only if given just after the display of a particular clue. 
When the right answer is given, it can be underlined and the course can go 
on, or, if you prefer, a special right-answer message can be displayed as the 
last action of the program before proceeding. Another option is to ask the 
student whether (s)he wants to see ail the clues remaining in the bank aficr 
getting the right answer. Or, if you feel the clues are of value to all 
students, you can instruct the computer to display all remaining clues at 
the end of each item without asking the student's permission. When the 
last clue has been displayed after a series of incorrect answers, the program 
win give the correct answer to the student (in the case of several alternate 
answers, you specify which one the computer should choose). Then, if you 
have so requested, the computer will ask the student to type the answer as 
displayed and will not go on to the next item until (s)he has typed it 
correctly. 

You have more than a single bank of clues at your disposal to help put 
the student on the right track. The clues referred to above were general 
ones: any wrong answer would bring forth the next clue. In addition, you 
can provide response-specific clues. If you anticipate that a particular 
wrong answer is likely, you can direct the computer to reply to that 
answer, whenever it is given, with a special clue. For each item, several 
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different expected wrong answers can each be programmed to call forth 
their own response-specific clues. When any other, unanticipated wrong 
answer is given, the new general clue will appear. 

In addition to these two types of clues, you may decide whether to 
provide a special dispensation known .^s "percentage feedback." With this 
feature, a subroutine is invoked to check wrong answers for the possibility 
that they are, for example, really just misspellings of one of the right 
answers, if the answer falls within the author-specified percentage of 
correctness (in our example, thus being classified as a misspelling), then its 
correct characters are put back on the screen in correct positions, with 
blanks where characters were missing, and the student is given a chance to 
correct the answer. Such a feature can be quite handy when, let's say, the 
desired answer is "probabilistic," which almost no-one spells correctly the 
first time around. There is, in addition, a special signal to tell the student 
that the answer (sjhe has given contains the correct answer within it, but 
also contains incorrect or irrelevant material. 

With CLUEGEN, you can decide almost as you see fit what scoring 
formula to use. Different general clues and different response-specific clues 
can, when tht'y appear in response to a wrong answer, subtract different 
amounts from the student's score, depending on the relative deficiency 
that you think the need for each particular clue indicates. Students' scores 
can be displayed to them periodically or kept secret, as you prefer. The 
score received on a given problem or question may be used to determine 
whether the student encounters it again at a later point. For each problem, 
you specify how bad a score the student needs to get in order to make the 
problem reappear. If the score is worse than this level on the repetition as 
well, the problem is later repeated one more time. Clues need not be the 
same for each appearance. So, for example, if you think that anyone 
encountering a particular problem for the third time must be misunder- 
standing the clues, you can provide a special, easier bank of clues for the 
third appearance. 

Randomization is available when desired: the items (problems) can be 
presented in random order, or the (general) clues within an item can be 
randomized. Sequencing can further be modified by skip and exit 
commands. The author can, in other words, decide that the achievement 
of a particular score at a given point in the course should exempt the 
student from the items that follow until a new topic is reached. By the 
same token, of course, the invocation of such score-based routing can be 
used to give special remedial work to students having particular difficulty. 

As can be seen, CLUEGEN allows you to do many different things, and 
hence requires you to make many choices. You supply the text of each 
question or problem, the text of each clue, and the text of any final 
message to be shown after the correct answer is given. Obviously, you also 
specify what the correct answers are. In addition, you make all the other 
choices mentioned above, and several not mentioned. There is a total of 65 
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parameters, at present, which you can set in your CLUEGEN input deck, 
i.e. 65 different kinds of choices that the package allows you to make. 
Normally each choice requires punching one or two control cards, 
following the formal and instructions in the manual for the package 
user. Bui this freedom to choose among alternatives does not mean thai 
you are burdened with preparing a painfully large number of control cards. 
A parameter, once set, remains set until and unless it is reset later in the 
input deck. Further, every parameter has a default, i.e. an alrernalive that 
the package designers expected to be most frequently chosen. If you 
accept this alternative, you need not Specify anything. Thus, in general, 
off-beat lessons will require more control cards than typical lessons; and 
inconsistently off-beat lessons will require the most cards of all. But even 
the most cleverly complex CLUEGEN input deck can be put together in a 
fraction of the time it would have taken to write the CAI lesson program 
that this deck generates. 

There may be contingencies, of course, which CLUEGEN does not 
provide for. One example is the sophisticated analysis of the student's 
response according to some special rule. Situations like this can be taken 
care of by the "jack" built into CLUEGEN. in place of any clue, a special 
program provided by the author can be invoked, which sends its result 
back to the CLUEGEN-produced program for further processing. 

CLUEGEN is organized into a hierarchy of instructional units. The 
highest level is the course. Courses are divided into segments^ these are 
divided into lessons, these into modules, and these into /Ye/775. The various 
parameters are not all set at the same level, but each at what seems the 
most appropriate level. Student scores, for example, can be shown at the 
end of each item and/or module; they can be shown at the ends of the 
items in one module, shown only at module-end in another module, shown 
at both item- and module-end in another module, and not shown at all in 
still another module. For purposes of problem repetition, the module is 
the unit of aggregation. Items on which the student score dictates a 
reappearance are put back at the bottom of the module's slack and 
reappear after the other items in the module. 

In accordance with this organizational scheme, a lesson might consist of 
all the material that students were expected to go through in one sitting, 
analogous to a chapter in a textbook. This lesson, in turn, would have 
several modules- perhaps one module of reproduction items, one of 
recognition items, one of practice items, and one of application items, to 
use the classification of Chapter 6. Or there could be modules of several 
levels of difficulty, and remedial modules, which would be executed or 
skipped depending on each student's score up to the end of the previous 
module. 

A few examples of political science applications of CLUEGEN are 
shown in Chapter 6, so additional illustrations will not be given here. This 
survey of three available packaged procedures should suffice to illustrate 
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some of the things you can do if you wish to write all your material with 
packages, and If your computing facilities allow you to use such 
packages.^ 

Correcting and Revising with a Package 

''Authoring," however, means more than writing, in the jargon of CAI. 
It means debugging, testing, evaluating, revising, redebugging, retesting, 
and so on. Hence one should not forget that packages have the valuable 
asset of providing for the recording of many useful data during program 
execution. Every student response, the display of every clue, every lapse of 
a response deadline, every score-in short, every step of the way for each 
student in the course is recorded on tape. These data are available for 
analysis-including with data-analysis packages like SFSS-to find out 
which students are having which problems, which items appear unclear, 
which unexpected wrong answers are appearing often and might be 
provided with response-specific clues for the next edition, and so on. 
Furthermore, since experimentation is often a part of CAI materials 
evaluation, the infallible memory of the ccioputcr can be tapped to 
measure the differences in student performance between two different 
versions of a course (e.g. one with and the other without the compulsory 
display of all remaining clues). Because of the modularized way that 
packages arc constructed, and because a single control card can set a 
parameter for a whole lesson, a change in any of the available choices can 
be made in minutes (even if it affects the presentation of every item in the 
lesson), and the new version of the instructional program is ready louse. 
Thus revision is quick, and the preparation of two versions of a lesson for 
experimental comparison is hardly more difficult than the preparation of a 
single version. 

The entire authoring process, when a package is being used, looks 
something like this: 
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The package is essenlially a computer program thai, with instructions from 
the author, produces (or "generates") another computer program. This 
o.utput program is one which will run the desired CAI lesson. The 
generp.tion of the program may take place on one computer, and the 
resultant program may then be taken (on tape, etc.) to another computer 
which delivers, or executes, the actual CA! lessons. Likewise, the package 
can be written in one programming language but generate lesson programs 
in another language. Ideally, users can request that their output programs 
be written in whichever languages are suitable for the computers on which 
they intend to run their lessons. Thus a single deck of control cards could 
be used to generate similarly functioning CAI lessons for two different 
computer systems-a job that would otherwise require writing the lesson 
programs separately in the two appropriate languages. 

Besides producing output programs, a package also generates print-outs 
to assist users in checking to see that they are getting what they intended. 
A print-out may contain applicab! : rrror messages, a copy of the input 
cards, a printed duplicate of the output program that is being written onto 
tape for later use, and a summary of the resulting lesson. 

The printed summary may take a number of different forms. In 
CLUEGEN. lor example, all the items can be shown, or just one or two 
items from each module. For the items that are shown, the problem, the 
set of anticipated responses, and the clue bank may all be printed out, or 
just the problem and the response set, or merely the problem (perhaps for 
use in a pretest). The print-outs are useful for proofreading and also as 
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documenlatlon from which other institutions can quickly determine the 
applicability of the material to iheir needs. 

In conclusion, CAI packages serve two main purposes: to economize 
the efforts required to create computer-based lessons, and to facilitate the 
sharing of such lessons among institutions. We expect progress on both 
fronts to continue in the near future. We believe we shall witness the 
development of these packages, within a few years, to be point where they 
can be used not only in batch mode, with control cards, but also 
interactively, so that the author is prompted by the package itself to 
supply the needed text and parameter choices at a terminal,^ We also 
anticipate that in time the major packages will achieve wide transferability, 
so that a version of any course for delivery on any system can be produced 
quickly and inexpensively. 



FOOTNOTES 

1. The procedures described here have been reported on in several 
unpublished conference papers and internal reports, by B. Weneser and 
others. Two recent articles are B, Sicgel, "The Stony Brook Author 
System: How it Facilitates Curriculum Development," ACM SIGCUE 
Bulletin, 6 (no. 4, Oct., 1972), and D. McMullen, "Generative CAI: 
Procedures and Pro<>pcc\s/' Educational Technology, Feb.. 1974. 

2. The complexities of making a particular package work at a particular 
college are so varied and changing that no generally applicable advice can 
be given here. Also, packages are under continual revision and new ones 
are springing up. At present, those interested in choosing among available 
packages and using one or more of them at their colleges will probably 
find personal consultation to be the only source of reliable information. 
The best place to start, at colleges without a CAI laboratory, is probably 
the campus computing center. For general information on problems of 
transferring CAI programs from one campus to another, or of producing 
programs usable at many different installations, see J. J. Turnbull, 
'Transferability of Computer Software for Education," and A, Kent 
Morion and Arthur W. Luehrmann, Jr., "Proieci COMPUTe: A Mechanism 
for Producing and Distributing Instructional Material,*' in Computers in 
Educationllnformatique et cnseifjnement, ed, O. Lecarme and R. Lewis 
(New York: American Elsevici. 1975), part 2, 989-97, One obstacle to 
transferability is that terminals at different places are endowed with 
different capabilities. Some write on paper, others on screens. Most display 
in black and white, but some display in color. Some can print only letters, 
numbers, etc., while others can display anything. Finally, auxiliary devices 
such as microfiche projectors, filmstrip proicctors, tape recorders, light 
pens, music keyboards, and speech synthesizers are attached to' some 
terminals to permit more variegated student input or computer output. 
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3. Cf. Roger E. Lcvicn et al., The Emerging Technology: Instructional 
Uses of the Computer in Higher Education (New York: McGraw-Hill, 
1972), pp. 504-5. 
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Chapter 4. 
Playing Politics: 
Reflections on an Experiment in 
Computer-Based Education 

Fred S. Coombs 

One difference between magicians and compuler-assisied professors is 
that the professor is always ready to tell how he did ii. In this narrative I 
would like lo reminisce a little about ou: Political Process Inquiry (PPf) 
project^ ai the University of Illinois, Urbana-Champaign-how we used 
computer games to captivate students in our introductory American 
government courses, taught them something about political processes and, 
at times, succeeded only in mystifying them. 

Many of our ideas worked well; some did not. In either case, those 
contemplating similar kinds of curriculum development may profit from 
our experience and assessments. There are also the inevitable afterthoughts 
about how we could have done something better, and visions of what we 
might be doing now if we had just a little more time, talent, or money. 

In the Beginning 

It was the fall of 1966 when the political science department first 
looked carefully at a system of computer-assisted instruction- 
impertinently named PLATO (Programmed Logic and Automatic Teaching 
Operation)~being developed on our campus. However technologically 
complex, the logic of the thing seemed simple enough. Students sitting in a 
booth equipped with a typewriter-like keyboard and a television-like 
screen (CRT) could interact with a large, pre-programmed computer (CDC 
1604). By pressing the usual alpha-numeric characters, plus certain 
"function" keys (e.g., "NEXT," "HELP," "JUDGE," or "COMMENT") 
the student provided input to the computer, which was programmed to 
respond instantly by plotting text or diagrams on the screen. The 
computer could also select an appropriate 35 mm photographic image 
from a slide bank for superimposltion on the same screen. Thus, in a 



59 



56 Playing Politics 



si raighl forward program, the sludenl might be presented with, let us say, a 
problem concerning Ohm's law on the screen, would type in an answer, 
have it judged by the computer, and, if correct, move on to the next 
sequential step. If the answer were incorrect the computer could supply 
''help" routines designed to remedy the difficulty, then let the student try 
again. 

Almost immediately, however, instructors began to design more 
imaginative teaching logics which the system could also accommodate. A 
course in practical nursing called upon the student to ask for relevant 
information about the patient, make a diagnosis, and prescribe proper 
treatment. A chemistry unit presented an "unknown chemical" which the 
student was to identify by performing certain "tests" upon i; and eliciting 
data about its molecular structure. Students in a genetics course could 
perform the familiar "fruit fly" experiment (which takes weeks in a 
laboratory) in minutes on the PLATO system and see the results of their 
manipulations neatly portrayed on the screen. 

Even the uninitiated professor could become proficient at "authoring" 
PLATO programs relatively quickly, by virtue of a unique near-English 
language called TUTOR especially designed for computer-assisted instruc- 
tion.^ A teaching program could, in fact, be developed by an instructor 
from any of the student terminals by simply switching into "author 
mode." The system also automatically stored the record of every keypress 
made by each student .md this record could be retrieved by the instructor 
at a later time for analysis of student performance. With a little additional 
programming, it was even possiole to obtain summary statistics of the 
performance of a dais of students, such as the percentage who had 
required "help" on a given task, or :.he average length of time taken to 
solve a certain problem."* 

Students worked through the programs at their own rare, although a 
program might prohibit them from moving to the next task until a given 
level of mastery wa'. obtained on an earlier onf By the same token, 
students who dispiay-J a command of the subiect matter early in a 
sequential program might automatically be skipped to niatcrial more 
appropriate for their level of competence. 

The most distinctive featu''c of the system, when compared with most 
other CAI syAcms, was the almost unlimited flexibility it provided the 
author in the design of instructional p'-ograms. : '^cre was ample 
computing power and space to present sophisticated, complex instruc- 
tional programs lo about thirty students at the same time. It was, even in 
its early stages, a system which imposed relatively few constraints upon 
authors, and program designers frequentlv found themselves changing their 
approach in mid-lesson as new • bette^ ways of achieving objectives 
became apparent. 

Technically, PLATO has undergone major changes in tlie ensuir.g 
decade, but from the author's viewpoint the basic logic is much the same. 
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Some ot ihc changes hdvc been ccc.uioniically inspired. Tfic sludcnt 
terminal has been redesigned, in PLATO IV, with the CRT screen now 
replaced by a "plasma display panel." This permits linking ihc terminal to 
the central computer configuration by means of existing telephone (rather 
than video) lines- a riiaj^^r economy when contemplating several thousand 
terminals blanketing a state. Photographic slides are no longer centrally 
located but prepared on a fiche which each student inserts into his own 
station for rear-view projection on the screen. A random access audio 
device (under computer control) and a "touch panel" feature (to permit 
student input by touching the screen rather than pressing keys) are 
optional with the new terniinal. The CDC ! 604 computer has now given 
way to a CDC 6500 with vastly expanded auxiliary storage and retrieval 
capabilities. The TUTOR language has evolved into an even more 
powerful, if somewhat more imposing, means of coaxing that computer to 
do the bidding of profess(jrs who may still feel more comfortable with tfie 
Athenian Plato than the one in Urbana. 

The existence of such a system was of special interest to some members 
of the political science department for a very practical reason. The 
department's instructional program was taking its lumps. There had been 
sharp, usually losing, battles with administrators over C(jurse si/e limits, 
assistantship funds, and advising loads. Furthermore, student course 
ratings were just coming into vogue, and professors nursing their freshly 
bruised egos began to sense an unmistakable need to do something 
differently. The problem was most acute .it (he lowest level the 
one-semester, thrce-credit-hour "American Government: Organization and 
Powers" course (PS 150). The symptoms arc all too familiar to most 
university faculty; an intrcjductory course which could be selected to fill 
sequence requirements by students in the lower classes from a variety of 
curricula, enrolling up to 1600 students each year, with lecture sections of 
about 500 students meeting twice a week and dividing into smaller "quiz" 
sections, manned by graduate assistants, once each week. It was a course 
remembered by graduating seniors as among the ten "least stimulating" in 
the College of Liberal Arts and Sciences in College surveys. Student class 
attendance was chronically low and most faculty members had persuasive 
reasons they could not teach the course prepared well in advance of tfie 
department head's earnest search for volunteers each semester. 

An incoming department head with a taste for innovation decided the 
department should attempt to resuscitate its instructional program by 
capitalizing on available resources. Toward that end I was hired as an 
instructor with released time to explore the PLATO system's potential for 
political science. I had some background in education, but no explicit 
training in programmed instruction, CAI, or, for that matter, anything 
connected with computers beyond several all-night sessions spent at balky 
ke\ punches and waiting for data to be processed by packaged st^itistical 
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programs. A half-limc graduate rcscarcJi assistant was niacie available and 
the brainstorming began. 

The Early Decisions 

What could the PLATO system do fur political science instruction? The 
answer was not immediately clear. Our thoughts turned first to conven- 
tional kinds of programmed instruction. One could, using any of the 
standard government texts as a guide, create a course on PLATO whicli 
would consist primarily of textual material frequently interspersed with 
questions to which students would respond and have their answers judged. 
The problem with this was that it would have represented an embarrassing- 
ly inefficient use of a learning system which was capable of much more. In 
fact, it is probable that the same educational objectives could have been 
achieved with a much less expensive programmed textbook. 

So we asked ourselves a more difficult question. What could the 
PLATO system do that can not be accomplished in any other way in the 
political science classroom? It seemed to me that one of the major lacunae 
in political education at all levels is that students seldom have an 
opportunity to observe, in any systematic way. the processes they are 
presumably learning about. To put it another way, there is typically no 
equivalent to the laboratory experience tliat plays such an integral role in 
biology, or chemistry, or physics instruction Discussion of current or 
historical poh'tical phenomena can provide a sense of what happens when a 
President pursues strategy "A." but what would have happened with 
strategy "B" in the same situation is left to undernourished speculation. 

One can learn about governmental structure from textbooks, but how 
does the instructor convincingly portray the process -the "if-then" 
gcncrali/?ations that form the nexus of empirical political theory? Could 
programs be developed which would allow students to discover and test 
some of these principles for themselves? 

A second line of thought was more concerned with motivation. Highly 
abstract presentations of process theory might dull even the best-conceived 
lessons for freshmen and sophomores. Why not put students in key 
political roles and let them experiment with various strategics in trying to 
achieve their objectives? They would have to commit themselves to 
real-life choices and could witness the consequences of those choices. 
Aside from personalizing the process, there would be the challenge of 
trying to improve their performance as additional principles were 
discovered. 

The decision to concentrate upon role-playing games which would 
illustrate key political processes had several important implications."^ First, 
it meant that we would not develop a course per st\ but lessons designed 
to supplement introductory courses. It would be an attempt to do only 
that which could not be done as well or better through lectures, reading, 
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or group discubsion. Second, ii muani ih.u much of our cllorl would go 
Into the development of the models themselves. Even a short computer- 
based game designed to be played in one class hour or less would take 
weeks, and sometimes months, to research, create, program, test and 
refine. 

Third, there was implicit in the selection of role-playing games a 
commitment to student inquiry and discovery as an Important part of the 
learning process.^ Generali/^ations would not, as a rule, be supplied to 
students in verbal form for memorization and application, but would be 
tucked away in games, to be teased out, piece by piece. Intuitively, 
Imperfectly, through experience in playing and replaying the games. One 
extremely important objective, we reasoned, would be a sharpened 
sensitivity to regularities in political life and an ability to develop and 
refine one's own generalizations on the basis of observation and 

experience. Simplified models incorporating some of the theoretical gems 
most prized by political scientists would provide an excellent opportunity 
for students to develop such skills. 

Much of the same philosophy, of course, underlies the various 
simulations designed or adapted for use in political science courses.^ Our 
exercises would differ in two fundamental ways from most classroom 
simulations, however. In the first place, single students would, in essence, 
be playing against the machine, not with and against classmates. They 
would, through their terminals, communicate and interact with other 
''actors'* as the scenario developed, but the other actors would be 
programmed to respond as we believed real political actors would. In a 
sense, then, the only variable was the student's game behavior. If a student 
played an exercise precisely the same way twice, (s)he should obtain 
precisely the same results. This creates a strikingly different learning 
situation than exists in most simulations where students interact with 
other students. 

The other way in which we were to part company with some existing 
simulations was by reducing the length and complexity of the games. Any 
simulation is a simplified abstraction of reality but, from a learning 
standpoint, the more variables included, the more difficult it is for the 
student to detect the underlying principles- the "if-then" relationships 
built into it. It is my conviction that many of the better-known 
simulations, however valuable they may be for motivating students and 
raising theoretical questions, fall shy of their promise to clearly demon- 
strate the principles involved. The typical reaction of many students at the 
conclusion of such a simulation (which may have run o\'er a period of 
several days) is that they found it interesting, but arc still not quite sure 
why it came out the way it did. Debriefing may help, and frequently gives 
rise to a desire to play it again to check out some of their hypotheses 
about the process. But, even if there were time, there is no assurance that 
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other siudenis would obliginj^ly play iheir roles the same way, and the 
possibility of confusion persists. 

This problem was to be mitigated by creating short games, each 
incorporating no more than a handful of basic principles, which could be 
replayed by students several times, allowing them to experiment with the 
model until they were satisfied they had ferreted out the principles 
embodied in it. 

These were the major itleas that went into a proposal to the ESSO 
Education foundation, which was then supporting innovative develop- 
mental programs in undergraduate instruction. It would be over a year 
before that proposal bore fruit, but we immediately set about developing 
the first exercise. 



To speak glibly of role^playing games which would portray key political 
processes is one thing to develop them is something else. Our attempts to 
identify basic principles in a given area of American politics- whether it be 
legislative behavior, or foreign policy, or the budgetary proccss-and 
fashion a believable, interesting, playable game which would incorporate 
those principles was at once the most taxing and the most intellectually 
exciting part of our work/ 

In retrospect, I think we got off on the wrong foot. We started with a 
cautious, straightforward branching program that was to lead the student 
to some principles of constitutional law in the due process domain. The 
student, as police chief, would have to make a number of decisions in 
connection with a controversy sparked by the visit of a radical speaker to 
the community. Should the speaker be permitted to speak? How should 
the crowd be handled? Who, if anyone, should be arrested when trouble 
broke out? At what point? When students acted in accordance with 
prevailing Supreme Court decisions, the game continued. When they 
violated constitutional dicta they were shown the error of their ways by a 
friendly city attorney, armed with excerpts from court cases, and asked to 
reconsider their decisions. They were called upon, at scvcrii! points, to 
justify their actions to a skeptical mayor and the press. 

In our effort to find an area where we could give students a relatively 
clear-cut "right" or "wrong" response to each decision they made, and in 
our initial reluctance to let students proceed after making a "wrong" 
choice, we had hemmed ourselves in. The scope of the exercise was 
limited, covering only a few specific applications of several constitutional 
principles. Because it was a branclvng program, the student was limited to 
three or four options at each choice point, and a frequent complaint was 
that there were other actions one thought made more sense, but couldn't 
try. Most important, it really wasn't much of a game, since the only real 
challenge was trying to work through it without being told that a decision 
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should be rcconsidtM cd. Tficrc was no opportunity lor students to specify 
their own objectives and work toward them, and the outcome was always 
the same, although some students reached it more quickly than others. It 
served a purpose, however, in acquainting us with the programming 
idiosyncracies and the potential of the PLATO system. 

From that point our thoughts turned toward more sophisticated 
schematic or mathematical models which would give studefits more 
latitude in their choices and provide a far greater range of outcomes. With 
funding from the IZSSO Lducation Foundation supporting several graduate 
assistants and consultants, five more games were completed by the fall of 
1970. 

CANDIDATE: You are a congressional candidate seeking election to 
the f-lou^e of Representatives. You may request information at the out- 
set about the composition of the electorate in your district (party 
identification, ethnic breakdown, social class makeup, etc.). As the 
game progresses you will also receive inforniati(jn about vour oppo- 
nent's characteristics and moves. Your task is then to make a number of 
strategic decisions concerning the allocation of your financial resources 
in the campaign and what stands you should take on various issues. An 
estimate of the predicted p{)pular vote in the district based upon a 
voter-type model is calculated from the initial parameters and modified 
by each strategic decision you make. You may, at various points in the 
campaign, request a poll of the district to ascertain how you are doing. 
CHAIRMAN: This exercise is an introduction to legislative politics in the 
U.S. Congress. As Chairman of the Education and Labor Committee in 
the House of Representatives, you are charged with the responsibility 
for steering a higher-education bill through the House. You arc 
confronted with a series of decisions that will influence the shape and 
ultimate passage of this critical piece of legislation. Alternative 
strategics arc suggested at each choice point and each decision you 
make affects the division of sentiment in various committees and the 
House on that bill. Your objective is to mobilise support for the 
strongest bill possible without incurring unacceptable political costs to 
yourself. Information about the current division of vote in the House 
will be available at a few points during the game to assist you In 
deciding what kinds of compromises, if any, arc called for. Parameters 
for this game may be changed so that you begin with any desired initial 
division of sentiment within the House, the Subcommittee, and the 
Committee. 

PRESIDENT: In this exercise we employ a complex scoring and branch- 
ing system to judge your responses. You arc assigned the role of President 
of the United States and face a severe Middle East crisis. Your objective 
is to maintain favorable relations with the Soviet Union, Israel, and the 
United Arab Republic throughout the crisis. There arc four discrete 
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cpisoclos which you work your way ihioiij^fi as iho crisis clovol{3[5S. Kach 
of those will call lor a scries ol decisions on your pari, and your 
performance in ihe episode will be scored on scvertil dimensions such as 
"consistency," ''power capability," and ''tension v/s a vis USSR." 
Adroit nitincuverin^ in one episode will result in a score profile which 
.if fords you hotter options in the next. One unique feature of this 
mode! is thtil as you select less than optimtil courses o\' acticjn your 
range of options on tfie next move HiUTows. !n tfie worst situation you 
may find you fiave only one course of .iction remaining in that period. 

IJiADLR: Mere you are the organi/er of a teacher union and serve as 
their bargaining agent in negotiations with the board of education. Your 
task is to mobilize support among teachers for your program and then 
extrtict what you can I'roni the district. In the process you must decide 
which iss.'es to eniphtisi/e, what level of demand you sfiould make on 
Otich issue, and wlv.it tactics to employ In the negotiation at various 
times. You must ttike mto account the dispositions of the board 
members on each isstfc tind also fiow your program and tactics will 
.iffect support within your own orgtini/{ation. At tlie outcome you are 
iniormed what you htive obttiined (or your teachns and fiow much 
support you have mobilized within youi orgtini/tUit 

BURllAUCRAT: As Director of a state [^eparlment of Mental Health, 
\iju are responsible for developing budget recommendations for tfie 
next fiscal year. You mti\ recjuest information about tlie objectives, 
performance, and operating costs for each of the five divisions witfiiti 
your defvirtment and will need to tinticipate the reactions of the sttite 
budget officer, the Governcjr, and the legislature In making tind 
justifying yc^ur decisions tiliout how \o modify List yctir's budget 
requests. The model tissumes an incremental stale budgetary process; 
you will find thtit denitinds for continuation of current services make 
drastic program cuts difficult while, tit tiie Stime lime, requests for more 
than the usual increases in the budget of one division usually must be 
acc(M7iptii>ieJ by cuts in other divisions. 

There I. an inL^captiblc dilemniti in consiru such mcjdels. The 
retjuiremeni.^ uf the game tend l{) push one, ra liukly, bey(jnd the 

limits I,.*' ciirrent theory.^ Most of us, in lecluri ^.vriting textbocjks, 
develop the art ^i.iling principles timbiguous env^^^gi'. to sfip o\\ tdnnjsl 
any hook. Jn developing a computer-btised game one seldom has thai 
luxury. Tt'.ke, \o\ exjinple, the version of CANDIDATE wfiere the student 
is in the rt of a Krpublican congressional candidate running in a 
competitive di^li iLL. O: ■•rlnciple we want t(j convey is that it is easier to 
mobilize RLr -^licmN .trui Independents than Uj convert Democrats. Thus 
the studeiu sh ' ' c\perionce more success (tis reflected in public opinion 
polls and me t'ifi i vote) by utilizing limited campaign funds f or advertizing 
tmd Ctinvassin.; tiesigned to activate potentially svnipatfietic voters thtin by 
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allocMling icsourccs lo an allcnipl al i;cUiiig DLMTincialiL voles, Bui how 
Iarj;c should ihc ditleronlial hc^ Ami cxaclly wIumc is ihc poinl ot 
diminishing; rclurns? I'or purposes ot iho i;amc wc need a model lhal 
cnlculales a running lurn(.)Ul tigure and a division ot ihe vote based upon 
campaign decisions.^ 

Our resolulion ot ihis dilemma has been lo devise tuiiciions which seem 
reasonable and refleci ihe besl iheory we can tirid in ifie lileralure, but 
admilledly go beyond il. In some cases evidence tor the validily ot ihe 
resuliing model can be ublained trom real poliiical aclors who play the 
game and indicale where ihey ihink ihe resullsare fealislicand where ihey 
miss ihe mark. A slill niore demanding lesl would he lo coniparL- ihe 
pertorniance ot protrssionals on iheir iniiial play wilfi ihal of sUu)' iiv II 
was hearlwarining lo see a high Magnavox olticial experienced in labor 
ncgolialions achieve a more favorable selllenunn in ihe b.irgaining game 
(LEiADER) lhan anyone, including ihe aulhors, had previously gained. We 
have nol, however, pursued such validalion very syslemalically lo dale,^° 
One reason tor ihis lapse, nol enlirely a ralionali/alion, is lhal we 
would like sludenls ihemselves lo challenge llie rTKxIels in sub^equenl 
discussions. Once ihey have gained some undersianding ol ihe process as 
porirayod in ihc game, Ifiey are encouraged lo allack il on empirical as 
well as normalive grounds. If ihey cile a ceriain oulcome as unrealisiic, we 
can present whal evidence we have tor il and concede lhal we have made 
some csiimtiles lhal go beyond available iheory. Sludenls nitiy, on ifie 
oihcr hand, gram ihe realism of ihe model in, tor example, ihe 
BUREAUCRAT game, bui polilely suggesl lhal inal is a lousy wa\' lo 
allocale slale revenues They will ihen be challenged lo suggesl slruclural 
changes in slale governmenl which would lead lo a budgetary process 
more lo iheir liking. 

There were times, however, when the paucity of theory in an area 
subdued even our usually audacious approach. We wanted, at one point, lo 
create a game called NATION-BUILDER, where the student would be the 
president of a yuung counfy deciding what kind of nation to build over 
the next twenty years, and how available resources should be used to 
achieve those aspirations. Altfiough there were ample correlational data 
available on GNP, agricultural development, capital development, literacy, 
education, regime lc^\timacy, and other factors wc wanted to build in, \vc 
could find little basis for estimates as to the time Kig between investment 
in a road-building program, for example, and increases in GNP, much less 
when and how investment in universal elementary education could be 
expected to impact upon economic or political variables such as ''value 
added through manufacture" or ''regime stability.** The effort was finally 
abandoned. 

If the development of models proved more demanding than anticipated, 
gelling them coded and working on PLATO was less traumatic than 
envisioned, once wc knew what we wanted to do in a game and had it 
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wDikLHl oui sclH'mtUically or nitUhfiiMl ically. I'LATO .luiliors arc siioii^jly 
oncoLiragetl lu learn U) clo iheir own pio^rtininiin).'. on ilu- theory ih.U an 
inlimaie awareness of ihe Ctipabililies ol the langiM^e tuuj llie s^'sicni leaJs 
one U) allempl tilings one might noi havL* thoirghi ot otherwise. But 
Jirectors and stair of the Lilioraloiy housing PLATO wi-re always available 
to get us over a teehntCiil hurJIe (m suggi'si a more elegant Wtiy of 
prograniniiiig tin exercise. Since oui piojeci was oni^ ol the lirst niajo? 
el'toris in ihe socitil sciences, ihey weie more tluin ,\ liule curious 
themselves Abou\ whtU could be done in a field like [Political science and 
anxious lo ckniu)nstrtite llie .ippliLtibilily (W ifu' sysliMii in a new tirea. 



It still renitiineil it) be seen flow the exercises couki be em[)lo\'eLl to be^l 
tRivanttige in ^\^ introductory couise and just how effective they were.^^ 
An experimental section of "American Govefnmenl: Organi/tition and 
Powers" (PS 150), scheduk^d \n\ the fait ol 1^70, enrohed slightly over 
'200 LrndergraLkrtite stLidents. Tlie en siring experiment had two major 
objectives: to com[)are the best course we et)ukl devise with the cour se the 
depart n lent typictilly offered, and to ev.ilutite several different modes of 
instruction, including the com [luter- based gtimes, used in the experimental 
ct)urse. We were esfiecially interested in comparing students who played 
I fie computer games with An iniual number who spent tfie btime tinK)Lmt of 
time in discussion groups working tt)ward the same oliiectives. 

The experimental ctarrse was btised Lipori ti premise tfial, tibt)ve till, 
greater variety was needed. The number ol lectures was reduced 
somevvhtit, but k*cturirig remained tin important part of the course. Twt> 
weeks were set aside for tin in-class **presidentitil election simulation."^ ^ A 
basic text wa^ employed btrt sufipleriiented witfi numerous readings 
dealing with current politictil controversies, fl.ilf tlie students were 
randomly assigned to discus>ii)ri sections of tibout 30 students Ctich, led by 
graduate Ictiching assistants. The other li.Hf were tissigned to spend a 
similar timount of time playing tind discussing the coniputer-b.isecl 
exercises. A novel schedule Wtis d /ised which brought half the students 
into lectures for all three days some weeks and sent them into either 
discussion groups or the computer classroom for three consecutive sessions 
on tilteinate weeks while the other stt'denis atteruled lectures. Thus, from 
the student's Vtintage point, eight weeks vais spent in lectures, two weeks 
in the in-class simulation, and six weeks eitfier in discussi(vi groups or 
working on computer-based games. 

There were the usual prtjbleriis in assuring equivtilence between the 
experimental course and the large convenlion.illy taught section which ran 
concurrently. The lecturer in that regular course was tin experienced and 
respected senior professor. The choice for the experimental course was ti 
talented young instructor who had obtaincdj'avorabie student ratings from- 
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siudenls ihc previous two years. Teams of graduate teaching assistants 
assigned to the two courses did not differ substantially in talent or 
experience. The courses were listed In the same manner in the timetable in 
an effort to avo'*d bias in the kinds of students they would attract, but 
they were offered at different times and it was necessarx- to restrict the 
enrollment in the experimental course due to the limited availability of 
PLATO stations. The conventional course had a total enrollment of 
approximately 500 students meeting for one hour twice each week for 
lectures and in "quiz" sections (de\oted largely to discussion of lectures 
and readings) of about 30 students j.ich on the third day. Little attempt 
was made to standardize the content of the two courses. The conventional 
course was Uught much as it had been in recent years, whereas the 
experimental course focused bom-wh-it more upon nalysis of political 
processes. 

A pretest, including achievement items and poliucal attitude scales, was 
administered to 75 percent of the students in the experimental course and 
a smaller sample of the conventional course.^"* One set of 38 multiplc- 
choic- items, selected from exams used in the ^^S 150 course over recent 
years, constituted what we called the ' nventional achievement" 
measure. Scales designed to measure sever.ii kindb of political orienta- 
tions (e.g., "sense of political efficacy," "polincal cynicism," and severa: 
scales measurmg commitment to democratic values) were also included in 
the pretest.^ ^ The post-test, administered at the end of the course, 
included all the items on the pretest plus a set of 23 items which 
constituted our "'process achievement" measure intended to gauge 
students' ability lo recognize and apply ^'if-then'' kinds of gencralizalions 
in the political realm. ^ 

Also included in the post-test were semantic-differential measures of 
altitude toward the four types of instruction utilized (lectures, in-class 
simulation, discussion groups, and computer-ba>ed games) and some 
isolated questions about the student's reaction to the course as a whole. 
All students in the experimental course and the same sample from the 
conventional course were retested in the last week of the course.^® 

We hypothesized that students in the experimental course would have a 
more favorable attitude tOA-:>rd PS 150 than those in the conventional 
course, ai- well as tvvwu'd "political science" as a discipline. We also 
predicted that they would achieve as well as conventionally t.^ughl 
students on the CDnveniional-achievement subtest and better on l.He 
process-oriented subtest. Fin<-^i|y, we hypothesized that the computer- 
based games would be more favorably evaluated as an instructional form 
than the discussion sessions. 

As the experimental couise got underway students assigned to the 
computer games quickly developed their own styles of coping with the 
terminal. Some approached it timidly, almost reverently at first, taking 
careful notes of messages that appeared on the ^creen and trying not to 
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ma!<e "rr ^ukes" L'ven on ilieir first run tlirougli a game. Otliers attacked it 
more lik- a pin-ball machine. But the reaction from the begmning was 
almost universal'.- positive. Attendance was high and some students 
returned on Satuiday mornings to try a game one more time, sometimes 
bringing friends or parents with them. As the semester progressed, students 
began w compare notes informally and vie with one another to see who 
had achieved the largest election victory (CANDIDATE) or the largest 
salary increase for their union's teachers (LEADER) There were a so 
occa ional wails of despair as a "floor manager' failed to get the 
pJcsidenfs bill passed in Congress for the third or fourth straight ime 
(CHAIRMAN) Ultimate student outrage, however, was reserved tor those 
are occasions when there was a system breakdown. The san^e students 
who might have greeted news of a professor's illness with thinly disguised 
glee were simply unwilling to tolerate mechanical frailty or, the part ot 

''^si^udents were encouraged to type free-form comments at ;>ny time 
(after pressing the COMMENT key), and PLATO preserved both the 
profound and the profane for our inspection. This record alerted us to 
specific points of difficulty in the games as well as providing a more 
ecneral sense of what students found interesting and annoying. It quickly 
became apparent that, far from viewing the games as an academic exercise, 
many students placed a high value upon "winning," or at \^^fl"^^°2l 
iheir performance from one run to the next. Expressions of frustration 
could occasionally be traced to awkward or ambiguous programming, but 
were more frequently the resuU of having played a game several times w, h 
no noticeable improvement. Later in this paper we shall address the 
question of what can be done for students who lind themselves in this 
position. 

What Happened to the Students 

The most striking finding with respect to the experimental course was 
that students liked it. When asked at 'ho end of the term i they would 
have preferred a regular section of PS 1 50, 91 percent responded that they 
preferred the experimental course and would enroll in it again it they had 
ii 10 do over As for the computer games, an independent sui-yey ot 
student attitudes, conducted near the end "f/'^"^^ ^^^^^''^I^.^^^, '^^'J 
Computer-based Education Research Laboratory, lound 86 percent ot our 
students ready to advise friends to take the section of the course using the 

20 

'°Tt'' wou'd^'be'Tmistake, however, to attribute the favorable response 
solely to the .se of computer-based games. Differences in course 
evaluation between students who had played the games and those who had 
attended discussion sections on the same topics were typically small and 
not statistically significant. Both liked the new course in almost equal 
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measure. A more reasonable inlerpreiation would point to a cluster of 
factors~the variety of instructional modes employed in the experimental 
course, the reduction of the size of the lecture section, the appeal of the 
lecturer, the emphasis upon process as opposed to structure or definitions, 
the attempt to provide current and stiniulat-ng supplemental readings, and 
the use of computer-based games-as important in assuring the success of 
the experimental course. 

Since it was the first experience most students had had with political 
science courses, we were Interested in determining how their beliefs about 
the discipline might be shaped by it. The ratings of "poliiical science" by 
students in the experimental course and those in the large lecture course 
used as a control are presented in Table 1 . k is clear that students in the 



TABLE 1 

Mean Ratings of the Concept "POLITICA L SCI ENCE" by Students 
in the Experimental and Conventionally Taught Courses* 





Students in 


Studen ts in 


"POLITICAL SCIENCE" 


Experimental 


Conventionally 


Course 


Taught Course 


Good (bad) 


+ 1.13 


+0.51 


Exciting (boring) 


M.25 


+O.30 


Useful (useless) 


+ 1 .64 


+0 .92 


Meaningful (meanmgless) 


+ 1 .54 


+0.81 


Challenging (unchallengtng) 


+ 1.49 


+0.68 


Flexible (rigid) 


+0.31 


+0.19 


Interesting (uninteresting) 


+ 1.59 


+O.70 


N = 


130 


38 



•Ratings were made on a sevon-point bi-polar scale (ranrjifig. for scoring purposes, 
from +3-00 to -3.00) with the adjectival oppositos on uither end. Whtle in the 
original instrument half of the items were reversed, we have here assigned +'s to 
those ratings nearer the posttive end of the scale. 

experimental course section viewed political science as more exciting, 
interesting, meaningful, and challenging, for example, than students in the 
regular section. 

It should be noted, however, that attitudinal differences observed 
between students in the experimental course and those in the conventional 
course appeared to be limited to their evaluation of the cours- and the 
discipline of political science. We had thought that we might be able to 
detect differences in their characterizations of "politics" or their orienta- 
tions on standard scales such as "political efficacy," "political cynicism," 
or commitment to various democratic principles which would be attribu- 
table to their different course experiences. While such differences did rot 
emerge, analysis of changes between the pretest and post-test did reveal a 
startling general finding that students in all groups appeared somewhat 
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more cynical, fell less efficacious, and displayed less commiimeni lo 
democratic principles at the end of their course. Reflection upon the 
nature of the standard measures employed suggts: • ihat this finding should 
not be interpreted too literally. It seems probab'c that most students come 
to college with notions of their own efficacy and ba^.ic democratic values 
fairly well developed. The effect of Thc'f first college course in political 
science, which frequently emphasii^es ihe complexity of the political 
system and the imperfect rendition of democratic values in the real 
political world, may give them pause in checking the "strongly ag.';c" 
response to an item such as "The way people vote is the main thing that 
decides how things are run in this country" (political efficacy). If this is 
true, one function of introductory courses in American government may 
be to complicate pre-existing beliefs about how democracy works rather 
than reinforcing democratic values or one's sense of efficacy. 

On the cognitive, or achievement, side we found no differences between 
the experimental iind control groups on the set of "conventional" items 
drawn from multiple-choice exams previously used in PS 150. Stu^Jent, in 
the experimental course apparently missed little of what had hi^ t^ ically 
been expected by professors, or at least learned by stLuKvns, in PS 150. In 
the set of items developed to measure an under^ Jing of political 
processes, the students who had played the computer games performed at 
a somewhat higher level than either students in the control class or 
students in tfie experimental course who had been assigned to discussion 
sections (Table 2). The difference, while statistically significant, was not 



TABLE 2 

Performance of Students in Experimental and Conventionally Taught 
Courses on Conventional Achievement and Process-Oriented 
Achievement Post-Tests (Mean Percent Correct Responses) 



Treatment Group 

Experimental Course: 

Computer Gnmes Group 
Dtscussion Group 

Conventionally Taught Course: 



Conventional 
Achievement 
Post Test 



62% 
62% 
62% 



Process 
Achievement 
Post-Test 



67% 
62% 
62% 



63 
67 
38 



Number ot Multiple Choice Uems 



38 



23 



large enough to warrant great celebration. Wc had, frankly, expected them 
to do even better. 

The comparison uf student evaluations of the four types of instruction 
employed in the experimental course indicated that eacli of the four 
played an important, but somewhat distinctive, role in the eyes of students 
(Table 3). While the computer games were rated (by the students who 
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TABLE 3 

Student Ratings of Four Types of Instruction Employed 
in the Experimental Course 



Semantic Differential Item* 


Computer- 
based 


1 n -class 
Simu latio n 


Lectures 


Discussion 
Sessions 


Interesting (uninterestmg) 


+ 1 .S4 


+ 1.57 


+ 1,31 


+O.80 


Challenging (unchallenging) 


+ 1.36 


+ 1.42 


+0.69 


+0.36 


Pleasant (unpleasant) 


+1.79 


+ 1 ,45 


+ 1.17 


+0,61 


Useful (useless) 


+ 1.66 


+ 1.33 


+ 1 35 


+0,78 


Exciting (boring) 


+ 1.65 


+ 1.38 


+0 : 


+0.36 


Good (bad) 


+ 1 .60 


+ 1.30 


+1.5 


+0.74 


Meaningful (meaningless) 


M .44 


+ 1.27 


+ 1.34 


+0.81 


Active (inactive) 


+ 1.63 


+ 1.74 


+0.65 


+0.45 


Relevant (irrelevant) 


+ 1 .57 


+ 1.66 


+ 1.51 


+0.99 


Rational (emotional) 


+ 1.52 


-0.36 


+0.73 


+0.32 


Valid (invalid) 


+ 1.32 


+1.1 1 


+ 1.31 


+0,91 


Complex (simple) 


+ 1.03 


+0.87 


+O.50 


^08 


Precise (vague) 


+0.97 


+007 


+0.69 


-0.10 


Varied (repetitive) 


+0.86 


+ 1 .15 


+0.94 


+0.55 


Deep (shallow) 


+O.80 


+0.44 


-^1,06 


+0.34 


Reassuring (threatening) 


+0.27 


+0.25 


+0.41 


+0,50 


Flexible (inflexible) 


+0.24 


+ 1.19 


+ 1.13 


+ 1,32 


Personal (impersonal) 


-0.02 


+0.72 


+0.56 


+O.50 


Usual (unusual) 


-1.69 


-1.71 


-0.72 


+0.26 


Important (unimportant) 


+1.13 


+ 1.25 


+ 1.20 


+0.52 


Clear (hazy) 


+0.42 


+O.05 


+0.87 


tO,30 


N - 


63 


130 


130 


67 



•Ratings ranged from +3.00 to -3,00 on a seven-point scale. 



played ihcm) as more "inlcrcsling/* "useful," "exciting," "pleasant," 
"meaningful," "challenging," "rational," "precise," and "complex" than 
the other three forms of instruction, the irvcia^> simulation was seen as the 
most "active," "unusual," "varied," "relevMnl.' and "important," Discus- 
sion sessions were rated the most "flexible," "personal," and "reassuring" 
instructional activity, whereas the lectures were seen as the most "clear" 
and "deep," and virtually tied with computer games for the most "valid" 
form of instruction. 

Each of the four modes of instruction used in the experimental course 
was positively evaluated on a "good-bad" scale ranging from +3.00 to 
-3.00. By contrast, students in the conventional course, which relied 
principally upon lectures and discussion, judged both of these conven- 
tional forms of instruction substantially less charitably. One plausible 
inference is that, in a course with varied instructional format incorporating 
new educational techniques, even the more conventional modes of 
instruction, such as lectures and discussion sessions, are better received and 
more valued by students. 
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Second Thoughts About Learning With Computers 

As d rcsufi of 'J- 'y oorlence in the cxperiaiervui' course and use of the 
cornputcr g.imes in S'/jy?q»ienl semesters ! have become at once more 
sanguine about sc:i^e of the froqucntly-heard criticisms of CAl and more 
^.keptical with respect to c'^'*tain claimed advantages. 1 see, for example, 
little evidence of the "de^umanization " of learning feared in some 
quarters. Whiic it is true ihit our [iiudenf rated the games as somewhat 
le<is "persona!" than lecture's or discussions, they still saw them as more 
"personal" than "impersonal." Fut hcrmorc, when PLATO cvaluators 
asked 50 of our students to rate the statement that "Computer-based 
education dehumanizes the student/' 48 percent "strongly disagreed," 38 
percent 'disagreed," C percent were "uncertain," 6 percent "agreed," and 
no one "strongly agreoo."^^ 

I do, however, rjow have an i:ic:eased sense of the desirability of 
providing opportjnity f(ir social interaction of various kinds in connection 
with the games. Because of the limited fiumber of terminals, we were often 
forced to assign two students to a single terminal and ask them to take 
turns, help each other, or perhaps compete with each other. The results 
were revealing. Aside from the obvie^us advantage that two people are 
likely to discover more than one, the students verbalized and defended 
their influences about the model to their partners, which served as a 
clarification and reinforcement of what t'ley were learning. Short 
discussion scbMons following a game-playing ijcriod served something of 
the same function. Even the student who has learned virtually everything 
contained in a game likes to compare notes with others who have played 
the same game, and those who end the session still mystified may profit 
from hearing their peers* ideas about what principles are operating in the 
model. There arc also value implications in most of the games which 
students arc eager to discuss. 

Other critics see ct)mputcr'based education as threatening the role of 
the instructor. It does change that role markedly, but in some desirable 
ways. We have already alluded to the intellectual challenge of preparing 
instructional materials, but there is also a sense of satisfaction that derives 
from working w/Y/? students at a terminal to help them comprehend the 
mysteries of a particularly grudging model. Students may even come to 
view professors and teaching assistants as people who are on their side for 
a change, in their struggle to figure it all out. 

On the other hand, I am less sanguine than before about that 
often-claimed objective of CAl: allowing every student to work at his own 
pace.^^ In the first place, individual differences in pace are enormous. It 
was not at all unusual for some students to take three times as long to 
complete a game as others. To keep the quickest students gainfully 
occupied for scheduled periods requires a staggering repertoirt- of 
programmed materials. More importantly, I am no longer certain thai tMc 
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student's own pace is always best. Some will work more slowly than they 
should, and others might profit from being a little more reflective about 
their play.^"* 

The most fundamental advantage of computer-based education is not 
self-pacing, or even the diagnosis of learning problems and individualized 
remedial help which a good program can provide, but the simple fact that 
students are actively and continually engaged l:i the learning process. 
Twenty, thirty, forty times a game, a student must make a decision, and 
that decision usually represents a commitment to some hypothesis about 
what will happen as a result of his choice. One mark of a good lesson is 
that it helps students develop accurate hypotheses about political 
processes rather quickly and gives them an opportunity to test them. One 
should not lose sight, however, of the importance on both cognitive and 
motivational grounds of that requisite first step wh ich is too often missing 
in lectures and even discussion sessions: obtaining the attention of the 
student and his or her active engagement in the business at hand. 

It is often suggested that the enthusiasm students display for 
computer-based education is attributable to the fact that it is novel, 
topical, and glamorous. Students do see the experience as novel, but also 
as a meaningful learning opportunity, and we have witnessed no 
diminution of enthusiasm over the course of a ^.emester. If, ht)wever, one 
means ^'Wouldn't they get tired of all-day sessions at a terminal 
throughout four years of college?" the answer is almost certainly "ves." 
While I could conceive of students profitably spending as much as 
one-fourth, or even one-third of their college careers on well-conceived 
computer-based programs, my view that it is not the best or most efficient 
way to accomplish all educational objectives is stronger than ever. 
Computer-based education will be valuable as a distinctive instructional 
mode which contributes to the variety of Uvming experiences students 
encounter. Those who view it as a pan.i^ : (or threat) which will 
ultimately monopolize the educational protes niss this important point. 

Finally, I now have a heightened appreciation for the paramount role of 
good lesson design and development in computer-based education. This is 
not to denigrate the importance of the system itself, which sets the limits 
on what an author can do. Unfortunately, however, even with a system 
comprising the most ingeniously designed hardware and computer 
language imaginable, it is much easier to write bad lessons than good ones. 
The Slate of the art is still primitive, and in many substantive areas there 
arc few guidelines to follow. If computers are to take their place alongside 
textbooks, lectures, discussions, student simulations, and other forms of 
political science instruction, high priority must be given to the develop- 
ment and nourishment of a cadre of political scientists with a flair for 
designing programs that arc b(nh substantively and educationally sound. 
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What Should Be Done Next 

The case is persuasive, I think, that computer yames can conlribuie 
significantly and distinctively to an introductory American government 
course. When CAl is made an integral pari of that course, students respond 
positively and the games play a role in engendering interest and more 
favorable student attitudes toward the course and toward political science 
as a discipline. There is also some, but iess impressive, evidence that 
students can gain a better understanding of political processes through 
computer-based games than through lectures or discussion sessions. While 
comparisons are encouraging, one senses that we have only begun to 
exploit the full potential of computer-based education in this cognitive 
domain. 

Part of the problem may lie in our initial estimate of students' ability to 
induce generalizations from even short, relatively simple political games. 
Many students can, but others proved perfectly capable of playing a game 
not just once, but two or three limes, discovering little other than a sense 
of growing frustration. What do we do about them? 

Several possibilities exist. One could develop routines in which, at the 
end of the game, the computer would analyze the students' play, diagnose 
problems in achie\'ing the desired outcome, and gently set about 
attempting to rectify students' misconceptions by presenting helpful 
analyses of their play or even entering into dialogues with them about 
their strategies. If all else failed, students might request a list of those 
underlying principles which they had successfully (although perhaps 
intuitively) employed in pla\'!ng the game, and those they had failed to 
comprehend and use. Students would then replay the game with their 
new-found knowledge. This represents a modification of the pure 
discovery approach to a paradigm in which, for students who need it, 
discovery and verific<ition would be mixed with judicious tutoring. 

Another worthwhile development, directed at the bJ'ne kind of 
problem, would be what might be called an "instant replay" feature in the 
games. One kind of question students frequently ask at tiie end of a 
session is "What would the outcome have been if I had threatened armed 
intervention back at the beginning of this Middle East crisis instead of 
seeking agreement with the USSR that we would both pull back our 
forces?" (PRESIDENT). In principle the game could be replayed, changing 
only tliat one decision, but that may strain both the memory and the 
patience of the student. An analytic program could be devised to change 
any decision (or series of decisions) the student had a later question about, 
calculate, and display the consequent change in outcome holding other 
decisions constant. This would provide students with a powerful means of 
dissecting the games in their effort to determine the assumptions built into 
the model. 
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What, then, of" students who play the games with relative savoir 
fa/re ~ho\w can the exercises be made more challenging to them? Some of 
the exercises already developed, and several others wc have thought about, 
have multi-dimensional outcomes. The leader of a teachers' union, for 
example, will be interested not only in the various aspects of the package 
(s)he is able to negotiate with the Board of Education, but in increasing 
the membership and resources which the union enjoys. Frequently there 
v/ill be tradeoffs where the student will have to sacrifice one objective to 
get something else. A simple feature could be added to such games which 
would require students, after gaining a preliminary understanding of the 
model, to "call their shots," i.e. to specify the outcome they want on each 
dimension, and work toward those outcomes in their next play of the 
game. Their original objectives would then be compared with the actual 
outcome at the end of the game, and their performance evaluated by how 
closely the results approximated their own goals. 

Elaboration of the games themselves, and experimentation with 
different kinds of games, are also in order. We are strongly committed to 
role-playing, but have not begun to exhaust the possibilities inherent in 
such an approach. Once a workable model is developed for a game it may 
make sense to let the student play several roles in succession. One could 
envision, for example, a judicial process game in which the student played, 
on successive runs, the role of defendant, police officer, defense counsel, 
prosecuting attorney, and judge. One could also make a case for some 
"data-based" models. We have made a gesture in this direction by 
providing in CANDIDA7T three quite different districts (with different 
socio-dcmographic composition, party alignments, and political histories) 
for students to choose from before they begin the game. There is no 
reason, in principle, that such models could not be modified to accept 
various data configurations (real or hypothesized) which students want to 
read in at the beginning of the lesson. Thus, the student W'ho wanted to see 
if (s)he could be elected as a Democrat in a district approximating his or 
her home district would bring the relevant data from that district to class 
and feed them into the terminal, then proceed with the role-playjng. 

Two other lines of development, frequently urged upon us, are 
tempting but perhaps more questionable on educational grounds. One of 
these is the creation of "interactive" games in which several students 
would each assume a different role in the same game and interact with 
each other through their terminals. The potential of such games for 
motivation of students is obvious. I am much less certain, however, of 
their relative merits {:i< contrasted to our games) when it comes to 
teaching students what you want them to learn about political processes. 
The point may be debatable, but I would argue that, however imprecise 
our models mny be, political scientists ought to be able to program the 
"other actors" in a g.^rrie to behave in more realistic fashion than they 
would if students were playing those roles. Furthermore, as with in-class. 
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dll-human simulations, in a multi-person computer lesson one loses the 
opportunity to replay the game, experimenting with different strategies in 
an otherwise controlled setting. 

The other tantalizing line of development would be to employ 
stochastic models in place of the deterministic models we now use. For 
research purposes the use of stochastic models is eminently sensible, since 
virtually all of the propositions in empirical political theory are stated in 
probabilistic terms.^^ From the author's standpoint, developing games 
with stochastic elements would mean that, instead of estimating each 
actor's most probable behavior in a given situation, one would estimate a 
probability curve for several different behaviors. It is easy enough to do 
this with most large CAI systems and we have, in fact, experimented with 
probabilistic features in two of our games. The upshot of this, from the 
student's point of view, however, is to make it more difficult to divine the 
nature of the model and its basic process laws. A student can never be sure 
whether "B" responded differently the second time (s)hc played the game 
because "A" had acted differently or through chance alone. One could 
now, in fact, make exactly the same decisions in two runs and obtain quite 
different outcomes. In a sense this would be a more realistic model, 
because chance factors (or exogenous variables) do play a role in political 
processes, but it may also complicate t^^-. cognitive task of the learner 
unnecessarily. 

None of the kinds of things we have discussed to this point can be 
accomplished overnight, but they are all feasible with the system, 
language, and talent at hand. There is yet another logical extension of our 
work which, while far more difficult to accomplish, would pay even 
greater dividends in student learning. Note that we have concerned 
ourselves almost entirely in the preceding pages with the most effective 
way to convey an understanding of political processes to students. This 
obiective presumes a body of theory which we as political scientists 
possess, and they as students need to learn. Yet we are painfully aware just 
how tentative and incomplete empirical political theory is in most areas of 
inquiry today. We forge ahead and create games incorporating principles 
about political process (some of which may still be subiect U) dispute 
among scholars within the discipline) and even go beyond those principles 
to try to create games with a general verisimilitude. 

This procedure, as any approach which attempts to convex' current 
political theory, prompts humility, and our attempts to encourage 
students to challenge the resulting models in post-game discussions is 
partly a confession of vulnertibility , but it is something else as w^ell. 
Sometimes I have suspected that the professors and graduate assistants 
who helped research and develop our models have learned more about 
politics than any undergraduate who has played the games to date. Is there 
a way to let students build theory as well as learn it? 
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Let us assume, lor a moment, that our studentb have arrived at as 
complete an understanding of one of our models as we can expect. 
Couldn't vvc then take them out of the role of consumer of theory to try 
their hand at theory construction? If they find parts of our model 
unrealistic, let them change the model itself modify tnc functions, add 
variables or delete factors they consider unimportant, or inject 'new 
propositions -in an attempt to make it more reali.^iic. They could then test 
their own modified models by repeated plays to see whether they appear 
more rcah^iic than the original. The practical and technical problems of 
including such an option are, at first glance, staggering, but the appeal of 
the objective giving students an opportunity to engag. 'hcmsclves in 
theory-building experiments is sufficient to place it high on our priority 
list of work 10 be done. 



And Why It May Not Be Done 

Any major effort ai curriculum innovation, and especially an effort 
involving computer-based education, rct]uires some mobilisation of re- 
sources if it is to succeed. I do not mean to dismiss peremptorily the 
possibility of profess(jrs striking out, on their own initiative, to develop 
imaginative materials for use in their (jwn classes, but the investment thev 
must make, and the attendant risk, may be substantial. W<Kk in CAI is jt 
once demanding and absorbing. There is always one more twist needed to 
make a program better, or the vision of a new kind of lesson which will 
make a difficult point crystal clear to students. Usually professional 
advanccmcni will come more quickly and surely if professors btick to more 
conventional forms of research in their own areas of expertise. 

Yet, developers of computer-bat,ed materials work under a majoi 
handicap in their entreaties to university administrators for support, li ib 
difficult to make a convincing case for the proposition that you are going 
to save them money, at least in the short term. The cost of most of our 
development work has been borne by outside funding agencies, but it docs 
not take perceptive administrators long to realize that their budgetary 
problems will not be relieved by providing students with computer 
terminals and original, high-quality learning materials. This is not the place 
tc explore the economics of computer-assisted instruction in detail. The 
founders of PLATO are optimistic that they can approach, and perhaps 
reduce, the current cost of providing college students an hour of 
traditional instruction. They do not include in their estimates the cost of 
program development, assuming that ultimately this will be accomplished 
much as textbooks are written and published today in a market system. 
For the department head faced with the limited availability of political 
science materials, however, some resources will have to be provided. 

Even relatively modest efforts toward developing CAI programs in 
political science will usually entail pulling people with a variety of skills 
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and inleresis logelher, providing initial financial and assistantship support, 
and gaining the assurance of departmental and university administrators 
that such instructional work will be valued and rewarded. Only under 
certain conditions-including widespread concern over the undergraduate 
program, availability of outside funds, a receptive faculty, the existence of 
a suitable CAI system, and the encouragement of innovative departmental 
administrators— can such efforts succeed. 

Those conditions prevailed at Illinois in the late 1960's. They no longer 
obtain here, and perhaps not in very many departments. There have been 
three changes in departmental leadership since the inception of the PPI 
project, and department heads found themselves under increasing pressure 
to restore the prestige of a department which had lost several nationally 
prominent scholars. Professors who have used the computer games in their 
introductory courses request space for more students each succeeding 
semester, but, just at a time when sufficient terminals are becoming 
available, administrative support has waivered. PPI games were being 
proudly demonstrated to the Governor and the staff of the Illinois Board 
of Higher Education at jbout the same time the young lecturer who had 
played a central role in the development of the experimental course was 
terminated and the director of the project was apprised that it was now 
lime to get back to writing articles and books. The lessons continue to be 
used in courses and to be cited as evidence of departmental instructional 
innovation in administrative reports, but support for continued develop- 
ment to realize the potential of this kind of instruction-the money, 
released time, research assistance, and, above all, the willingness to 
countenance within a department of political science the kind of 
professional specialization necessary for this sort of work-is, at best, 
problematic. 

Problems in undergraduate instruction are too persistent, ,?nd too 
potentially explosive, to be ignored for long. Though attempts to cope 
with them have an episodic character, it is essential that the political 
science profession continue to develop means to accumulate and share 
information, ideas, and experience relating to instruction. The belated but 
energetic efforts of the American Political Science Association toward that 
end, even in times of academic depression, are an encouraging sign. Still, 
we have only begun to learn what kinds of learning experiences will best 
achipve diverse objectives or how to employ them in the most sensible 
manner. 

Visionaries as well as skeptics abound in areas like computer-assisted 
instruction, but here, as in most complex domains, truth lies somewhere 
between their strident claims. Computer-based games, as well as other 
forms of CAI, can make an important contribution to our teaching of 
American government. They will not revolutionize it single-handedly, and 
the attack must be pressed on a broad front to improve perhaps the most 
neglected aspect of our professional responsibilities- the political educa- 
tion of undergraduate students. 
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FOOTNOTES 

1. The Political Process Inquiry project has received financial support 
from the ESSO Education Foundation, ihe Cunipuicr-Based Education 
Research Laboratory, University of Illinois, and the Department of 
Political Science, University of Illinois. Authors, consultants, and assistants 
who have made diverse contributions to the project include: Stephen A. 
Douglas, Louis Gold, Lawrence V. Grant, E. W. Kelley, Deborah Oakley, 
John G. Peters, Marvin G. Weinbaum, and James P. Zais. 

2. More complete descriptions of the PLATO system may be found in 
Daniel Alpert and Donald L. Bit/er, "Advances in Computer-Based 
Education," Science, 167 (March. 1970), 1582-90, and in Daniel Alpert. 
"The PLATO IV System in Use: A Progress Report," Computers in 
Educationllnformatique ct enseignement, ed. O. Lecarme and R. Lewis 
(New York: American LIsevier, 1975), lSl-85. How one goes about 
writing course material in TUTOR can be discovered by looking through 
Bruce Arne Sherwood, Tiie TUTOR Language (Urbana II!.: Computer- 
based Education Research Laboratory, University of Illinois, 1974). 

3. This feature renders the PLATO system valuable for many kinds of 
experimental research uS well as for instructional u^-j-y. For an example of a 
research application of the PLATO .ystem in political science, see Fred S. 
Coombs, John G. Peters, and Gerald S. Strom, "Bandwagon, Ballot 
Position, and Party Effects: An Experiment in Voting Choice," Experi- 
mental Study of Politics, 5 (February, 1974), 31-57. 

4. For an excellent ireatmcnl of the place of ganx^s in the learning 
process, see James S. Coleman, "Social Processes and Social Simulation 
Games," in Simulation Games in Learning, ed. Sarane S. Boocock and E. 
O. Schild (Beverly Hills, Calif.: Sage Publications, 1968), 29-51. A 
discussion of the potential role of ganu^s in political education, with 
particular emphasis upon the possibility of resociaiizing students for future 
political behavior, is presented by Philip M. Burgess and James A. 
Robinson, "Political Science Games and the Problem Solver State," pp. 
243-49 in the same volume. 

5. Numerous learning theorists and curriculum developers have argued 
that generalizations which students "discover" in the course of their own 
analyses of relevant information are retained longer and are more likely to 
be applied to novel situations than generalizations presented in an 
expository fashion. Some laboratory evidence, however, suggests that 
these assumptions about the superiority of discovery learning, at least with 
respect to retention, may be premature. See John T. Guthrie, "Expository 
Instruction Versus a Discovery Method," Journal of Educational Psycholo- 
gy, 58 (1967), 45-49, for a brief review oi that literature and a report of 
his own experiment which found the discovery paradigm leading to no 
greater retention but to better transfer of learning. 
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6. One of ihc LMiiicsi ircalmcnis of ihc role of simulation in the 
learning process is still among the most insightful: see Richard C. Snyder, 
"Some Perspectives on the Use of Experimental Techniques in the Study 
of International Relations," in Harold Guetzkow, Chadwick F. Alger, 
Richard A. Brody, Robert C. Noel, and Richard Snyder, Simulation in 
International Relations: Developments for Research and Teaching (Engle- 
wood Cliffs, N.J.: Prentice-Hall. 1963), 1-23. 

7. Perhaps the most enduring contribution of Harold Guetzkow to 
thinking about man-computer simulations is his insistence that computer 
simulations arc theories which require verification just as any Dther form 
of theory: Harold Guetzkow, "Some Correspondences Between Simula- 
tion and 'Realities' in International Relations," in New Approaches to 
International Relations, ed. Morton Kaplan (New York: St. Martin's Press, 
1968), 202-3. One does nut entirely escape this requirement by basing a 
model upon propositions for which there is prior empirical support. It is 
still all too easy to create a model in which several propositions, all 
supportable when considered separately, ct)mbine in ways which yield an 
unrealistic simulation. 

8. A helpful discussion o\' the way model construction exposes the 
inadequacy of social science theory and may lead to theory building is 
contained in John R. Raser, Simulation and Society: An Exploration of 
Scientific Gaming (Boston: Allyn and Bactin, 1969). 

9. The process of model building for several types of simulation is 
examined in Hart) Id Guetzkow, "A Use of Simulatitjn in the Study of 
Inter-Nation Relations," in Simulation in International Relations, 24-42. 
See especially pp. 33-36. 

10. Concern over validity' has been, with got)d cause, a major 
preoccupation of much of the literature about political science games and 
simulations. We should remind t)ur selves occasionally, however, that 
validity is not \hc only criteritin of a game's utility as a learning tool. Even 
a highly valid game might still be trivial, dull, ctmfusing, or educationally 
indefensible on countless other grounds. Political scientists have devoted 
relatively little attention lo the question of what makes a game 
educationally valuable. 

11. For a somewhat more formal account (jf the results ol" this 
experiment, see Fred S. Coombs and John G. Peters, "Computer-Based 
Games as a Political Laboratory," Teaching Political Science (forth- 
coming). 

12. The plea for a variety of teaching techniques within a college 
course is not new. Sarane S. Bt)ocock makes much the same pt)int, as well 
as an argument for shorter simulations, as a result of her experiments in 
urban sociology and social psychology courses. See her article "Using 
Simulation Games in College Course^,/' Simulation and Games, 1 (March, 
1970), 67-79. 
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13. Marvin G. Weinbaum and Louis H. Gold, Presidential Elcctia:)' A 
Simulation With Readings (New York: Holl, Rcinhari and Winston, 1969). 

14. One-fourlh of ihe students in the experimental class did not lake 
the preiesi to permit a later check for sensitization effects due lo exposure 
to the pretest. No surH effects were found. 

15. Items from t- ''conventional achievement" sub-test were of the 
following kind: 

A federal system of government is one in which: (a) power is divided 
constitutionally between two branches of government- legislative and 
executive, (b) power is divided constitutionally between the general 
(natri^nal) and constituent (state) governments, (c) power is divided 
constitutionally among three distinct units of government-national, 
state, and local, (d) power is given constitutionally lo one general 
(national) government and such other constituent (sMic) units as the 
general government creates. 

The concept of "separation of powtMs" is associated with: [a) 
Montesciuleu. (b) Plato, (c) Gabriel Almond, ft.') David Easton. 

16. Scales administered included Ihe "sense of political cfi'icacv" (5 
items) developed at the Survey Research Cente^ Mictilgan, "cynicism 
toward gov<'rnment and politics" (14 iien^) developed by Herbert 
McClosky, and "specific applications of free sp- ch and procedural righij" 
(8 items) also from McClosky. Documental. .m) for these measures may be 
found in John P. Robinson, Jerro'd G Kusk. jnd Kendra B. Head, 
Measures of Poiiticai Attitudes (An.^ A. jor, Mich.: Institute for Social 
Research, 1968). Student response:) were obtained (jn a fwur-point 
(strongly agree, agree, disagree, strongly disagree) continuum. 

17. Items for the "process achievement" sub-tesi, administered at the 
end of the course, were of the following kincl: 

In exercising political influence, a threat is more credible, henc' more 
effective, when it is: (a) unexpected, (b) communicated secretly, (c) 
accompanied by evidence oi a commitment lo carry it oui. (d) drastic. 
If you were responsible for su . •ssful managcmera of bi!i through the 
U.S. House of Representatives, Vvliich of the following would you view- 
as least damagino: (a) unfavorable treatment of the bill In the Senate, 
(b) unfavorable treatment of the bill In the Rules Committee, (c) lack 
of support from the Bureau of the Budget and relevant fedora! agencies. 
[d) the appearance of some unfavorable witnesses during coromitlee 
hearings on the bill. 

This sub-tesi was not an ideal instrument for o'ur purposes. To obtain a 
comparable measure for control and experimenta groups, we '■esorted to 
developing a set of new, unvalidated multiple-choice items of uncertain 
reiiabjilty. These Items v^ere designed to measure the studci^t's grasp of 
basic process principles presented In the computer games, in group 
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discussions, and in lectur( s. The>' dihercd from items in ihc "conventional 
achievement' sub-i- ^a in that a ' nowledge of process (i.e., the probable 
consequences (>' v,:molis actions ^.r events) was required to answer them 
correctly . ;i is '.^'.;abic, however, that multiple-choice items arc not the 
most apprtn^jrial : means of measuring such knowledge. A far better 
criterion o<' w'^-iher students learned the principles included in the 
computer 'JLj'd be a comparison of their performance on their first 

play wit'; p-" :iormance on a "!ebt" play conducted after they had 
experimented with the model. Such a technique could not be applied, 
however, to control groups who did not play the games but might have 
learned the p^ nciples in other ways during the course. 

18. To provide greater cc i' ..-ability across the three treatment groups 
(i.e., the compi ' group and the discussion-session group from the 
experimental veil as the conventional-course control group) we 
include in th; ly those students in each category for whom we 
obtained con . on both pretest and post-test. There was no 
significant dili^. ./i the means of these three treatment groups on the 
'^conventional acliievemcnt" pictest. 

19. There is good reason to believe that some of the differences in 
attitude and performance between students in the experimental and 
conventional courses can be accounted for by the familiar Hawthorne 
effect (see F. J. Rocthlisbcrgcr and W. J. Dickson, Management and the 
Worker (Cambridge: Harvard University Press, 1939)]. Although students 
came into the experimenul course expecting the usual PS 150, it did not 
take them lon^, to sense that new things were being tried. The pretest itself 
confirmed thai an experiment was underway and that they were part tif it. 
By the same token, the instructor and the graduate assistants employed in 
the experimental course may have been spurred to greater efforts at times 
because of their desire to see the experiment succeed. If so, that in itself 
constitutes a good reason for experimentation with no\'el instructional 
modes and course formats. 

20. To the question "How would you ad\'ise a friend who had a choice 
between taking this same course (including PLATO) or another section 
which covered the same material but without PLATO" students in the PS 
150 compu:> f games section responded as follows: 

"Avoid PLATO section !ikc the plague." 0% 
"Avoid PLATO section if convenient." 0 
"Take PLATO section only if convenient (it makes 

no difference but is a new exp^^rience) . " 14 

"Take PLATO section if at all possible." 60 

"Fight tooth and nail to get into PLATO section." 26 

N=:50 100% 

"Student Attitudes toward PLATO-Survey Results,' CERL Evaluation 
Report (jjnuary 28, 1972), unpublished. 
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21. This is one o." the four llems in the "sense of political efficacy" 
scale -originally appear ng :n A. Campbell and R. Kahn, The Voter Decides 
(Evaf . ton, III.: Row, ?"eterson, 1954), 187-94. 

21. "Student Attiludei." 

23. See Patrick juppcs, "On Usi.-ig Computers to Individualize Instruc- 
tion," in The Comp,4fer in American Education, ed. Don D. Bushnell and 
Dwight W. Allen (N;w York: John Wiley and Sons, 1967), 11-24, for a 
brief discussion r-f the ways in which individual differences in students 
may be accommo^jn-d by CAI systems and some of the limitations of this 
endeavor. 

24. There are, (;f course, other forms of CAI in which self-pacing might 
become a much more important advantage. 

25. Excellent descriptions and critiques of several of the leading 
simulations developed lor political research can be found in Simulation in 
the Study of Politics, ed. William D. Coplin (Chicago; Markham, 1968). 

26. See liic Introduction to this volume, fn. 10; and Chapter 2. 
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can attest). But compi'tors arc iu>i merely -or even cssentially--eificient 
calculating machines; rather, they arc complex devices for handling large 
amounts of information, and hence can also be utilized wiih non- 
quantitative data in radically new ways. 

The following report concerns a series of experimental usc^ of t.he 
Dartmouth Time-Sharing (computer) System m courses dealir.g '/ith 
political theory. These innovations reflect the view that con^puters can 
improve the relationship between faculty ind students in su-called "sott" 
areas, where the primary obiective is an increased undcJ standing ot 
complex problems. It will not bo assumed that the issues of political 
philusophy are in anv ^ quantifiable, nor indeed liiat such a 
quantification would be . .'f, "^iil an ai s ,; J'iy. 

While the following ; ^ :ocuses u,» ,h' uses ol compuTer-assisted 
instruction ir political phiiusopiiy, th::reioie, the mt:ilu'ds should be of 
relevance to a wide range of leaching situation^. \ \\ ice J, u.ic of the courses 
in which they have been applied a survey o; . theoretical and practical 
relationships between the biological sciences and politics is comp.irable to 
most st>cial science courses In the kin:l of substanove materials tau^^ht. 

Conceptualization 

The Problem 

The decision to experiment with CAI in political phik)st)phy was based 
on an observation and an assumption. The obse-vation, widely shared by 
those who * v^jh political theory, is that many students make egregious 
error*" .n their study of !anH)us political tlieorists. Wiiile false 

tt:' ; ■ liner the final examinations of undergraduate (and even 

g. . .e) students in many fields, they seem even more frequent in 
..ourse':^ political pfiiiosophy. No matter how carefully one has prepared 
,.-aditionc'! lectures, it is disconcerting to rcali^^e that, f(.)r some students, 
it. Augustine greatly influenced Cicero or that Rousseau claimed all men 
nave a natural right to p-^perty. 

Frustration with suci^ trivial errors led to an awareness that informed 
analysis or discussion of pr)litical philosophy is impossible with students 
who do not know a minimum of factual details. It is all too easv to feel 
that, since political philosophers discuss what are today called nurma- 
qucstioio o- values, students need only express their op/>;/o/'/5 about 
th'. works assigned in a course. On the contrary, political philosophy is as 
much a scientific discipline as anv ' V'er field in the contemporary 
curricL;lum~at least in the sense tha; .onccrn> d with an identifiable 
body of data which must be analy/L ^.cording to accepted canons ot 
method- 

Without wishing to go into the cpistemologicai status oi" philosophiy, 
therefore, suffice it to say that one cannot learn anything without a 
knowledge of the subject-maT.ter being studied. In political theory, thib 



87 



Computcr-AssisicJ Instruction in Political Philosophy 85 



subjcct-niailcr takes the form of JilTicult written works, nornially in 
prose, which both explain and evaluate polilitjl life. While it is tempting 
to speak of different theoretical pi^^itions as competing "paradii^ms**- 
using the now common terniinolO};;. >( Tfionias Kulin- one need not refer 
to the sociology of knowledge w the fundamental problem in 
teaching political philosophy: the stuc^.i: must learn the position of a 
thinker, be he Aristotle or Marx, be /'ore can be analyzed, discussed, or 
disputed. 

Political Theories as l^ets of Propositions 

A simple way of conceptualizing this problem is to consider the work 
of a major political philosopher as a set of propositions (using the term 
"set" in its technical, matliematical sense). This data->et has a structure, 
since the different statements made by a theorist are obviously not all of 
equal status Hence one of tlie primary purposes of scholarly research in 
political philosophy is to elucidate the ordering or priority of a 
philosophe r's statements, emphasizing those which are somehow funda- 
mental, ' ,ving how they are relatecJ to others, and inquiring into 
apparent of leal contradictions between propositions.^ 

Frequently, a course in political theory will follow a given concept 
(e.g., "freedom") or proposition (e.g., "all men are created equal") in ifie 
history of Western thought. If one assumes that a th';orist's work forms a 
set of propositions, such in approach concerns the intersection of the 
ci "a-sets ki.Ltvvn as [Uc political theories of Locke, Rousseau, Mill, etc. 
Similarly, historical analysis traces the evolution of a giver concept or 
proposition ai; it is utilized in (or excluded irom) the setsol p:oposit!ons 
elaborated by a sequence of philosophers. 

From this perspective, the tendency of students to make blatant errors 
in restating the theories of major political phik»sophers is more readily 
understandable. In our attempt to focus \hc students' attention on the 
perennial issues of Western political thought, we often emphasize the 
intersection of sets whose C(MUent has not yet been learned. As a result, 
the student is encouraged- and rewarded -for comparisons between 
thinkers before (s) he has fully understood their theoretical arguments. 

It follows that one would do well to stress accurate learning of the 
propositions in each philosopfier's work as a prec(jndition for discussing 
broader theoretical issues. Some might object that this approach rests on 
the debatable assumption that each political tfieorist was "consistent." For 
example, it is sometimes argued that philosophers evolved throughout 
their lives, either ciianging tfieir views or contradicting themselves 
fundamentally from one work to another,^ While logical contradictions or 
major changes in emphasis are of course well known in tne writings of 
some theorists, such a finding presupposes factual understanding of the 
data-Set con^.ti*uted by each philosopher's texts, ^ 

As a result, it seems valuable to assume, when teaciiing political 
philosophy, that a theorist's writings form a set of statements, and that the 
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firbl Uibk lor the student is to loam the iTiost important o\ those 
proposition^ witfi a hiv^h degree ol aceuraey. Courses in p(.)lilical 
philosophy can therefore be assumed to recjuire a eons icier able amount (M 
cognitive Icarnim;, not as an end in itself, but rather as a (.Mee<-)ndition lor 
intelligent diseussion, analysis and writing. 

This approach to teaehing politieal philobOph> underlies the experi- 
mental uses ol computers described below. It presumes that new metliods 
which increase the reliabilii of student cognitive learning are desirable, 
insofar as exact knt.jwiedge ol the subject-matter is an essential pre- 
requisite. But buch learnii^'.', tasks eanrun be the ultiniate locus of an 
examination of political [)hMosophy, since iiie ability to understand the 
implications of different llieories and ultiniately to niake inlormed 
political judgments must icmain the ultimate obiective. 

As will be noted, llie main emphasis has been (jn cogf.itive learning. It is 
also possible that phihjsuphical argument and anal\sis could be niore 
directly taught by means of com[UJter-a^sisted instruction. I'or example, 
the Socratic dialectic is characterized by a diaKjgue in wliich tfie learner is 
presented with a series ol LiLreslions in tlie \orm ol a branciiing tree (often 
based on "yes/no" o[)ti<)ns), wliere the learner's answers iielp determine 
the next question. In prif pie, there is no reas(jn why tliis metlnjd, whicli 
is sometimes used in classroom recitations, C(aild uo\ be adapted tn 
computer programming. To dale, tlo^^•evcr, our cAperinients liave been 
limited to the simpler and more general problem ol [promoting cognitive 
learning of specific propositions. 

Our experience suggests that innovaii\c leeiiniques ca- '^c "seriously 
considered for courses in political theory ii the\ satisfy two .,iiefia: first, 
improved learning of the the(jretical wor k^ being studied ; seciwid, absence 
of negative side-effects inliibiting the anai\ si> and discussion wfiich aie the 
primary aims of tfie educational process. Wliile the issue of possible 
side-effects requires more concern tfian is otlen evident in proposals lor 
technological innovation, it will be deferred until the e\[)erimrntal uses ol 
computers in political lheor\' have been presented. 

Why Use Computers in Traching Political Philui<^pfiy ? 

Computer-a sisted ;nstr-av,ti(jn (CAI) rests nn the obscrv.^; .n that the 
computer c.i;i se;ve .iS a rnctin^ of iniproving the student'- .-jk ledge. 
Computer simulation, ^amin^, or cjuantitLitive data analyJs provides 
experiences leading the student to findings tfut are less etfectively taught 
in a more didactic way. In C( lUrast, so-called "programmed instruction" 
(wliich may or may nr/i l)e adniinistered [)y computer) f(.)cuses more 
directly on specific concepts oi ri" )[V)sitir»ns that the student is expected 
to learn. 

The ba>>ic ,■ .nciple .idopted h.ere is simpK that computers can be 
utili/.cd to learji key pror->>>itions in the writings of a political theorist. 
Although ultimately inte ruled to improve iludents' understanding (jl 
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philosophic issues, computer applicdlions wore designed with the ininiedi* 
ate aim of increasing the accuracy o\' learning. 

While the techniques to be described below are still frankly experi- 
mental, and ev.iiuative data fragmentary, it must be empha^i/ed that the 
computer is NOT used as a substitute for any major element of the 
teaching process. Reading as5)ignnients. lectures, classroom discussions, 
papers, and examinations continue to be the core of the course. Rather, 
computer applications are intended as reinforcing devices in order t(; 
reduce the frequency of error in cognitive learning. 

Traditionally, several devices have been used tor this purpose, in me 
old-fashioned "recitation "-sti II utilized in many law schools-a randomly 
selected student is asked In restate or explain a given proposition during 
class. Although this may well be one of the more effective learning 
techniques ever devised (since the fear of public ridicule provides a strong 
stimulus to careful study), such "recitations" have gen, :ally disappeared 
from undergraduate education as classes have increased in si/e and a more 
sophisticated style has spread. Studefits now rebel at the notion that the 
prime function of a college-level course is rote recall of reading material, 
and t!ie recitation technic|ue is difficult in large classes tor those who lack 
tfie exceptional skills of Prof. Kingsbury in "Papcrchase. " Because the 
number of classroom hours per course has declined since the turn of the 
century in most colleges, moreover, use of this technique limits the lime 
available tor the lectures or informal discussion^ sought b\ nujsi 
on temporary students. 

Anottier traditional technique which efficiently assisted learning was 
the short quiz. Like the recitation, however, contemporary students tend 
to object to in-class winen assignments becau^e they ^eem "punitive" and 
appear to waste valuable iiiinutes of contact with f.ifii'ry. For the faculty, 
moreover, increased pressure for researeh and schoLtrly publication makes 
it less attractive to de\c'te time lo preparing and grading frequ-M quiz/es, 
to give five or more hours of class per week in e.ich course, or to offer 
three or more courses per term (ail of which .h.iracterislic of many 

colleges d geneiaiion or two ago). 

As a mean^ of surmounting [Uc^c ntoblem^, I experimented a number 
of years igo with daily qui/ze> con^^ting of one o' more mullipfe-choice 
questions on the assigned reading. Su h fixed-option items fKi\e several 
clear advantages; thev are easy lo administer and grade, incorrect 
responses can be designed to cM-ct typical errors, and the set ot options 
can readily serve as the ba>is of cLis^room discussion. 

For a i-irge class, however, this device also has d.Mwbacks. Griding and 
the sir.er volume of paper-work become incf;.^i.enient witfi more ih.-' .^5 
students in a class. If more rhan o.n, multiple-choice question j^ecJ 
during a normal cl -is session, detailed discussion of the qui/ can take up 
too much time, prevef ;ing full coveM^e other issues relating to a 
particular text. Yet if some items are not discussed in class, the student 
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docs not know why those questions wore asked, nor how they relate to the 
overall context oj the tlieory hein^; studied. 

It therefore seeined interesting to utilize the interactive possihilities of 
the computer to administer similar exercises outside cla^s iuairs. The 
principle of encouraging correct recognition of theoretical propositions 
remained primary, although pre-progf ai7imed responses, cxp/a/ning the 
alternative answers, also permitted better understanding of eacli option 
chosen by the studciii. Moreover, since administration of nuiiiiple choice 
or true/false questions on the computer permits the use of more !U (7is, the 
resulting worksheets allow an emphasis on the relationship, between 
different concepts and propositions. 

The precise type of computer-assisted instruction involved will be 
described in more detail below. Fiist, however, it would be useful 
to indicate how this us'; of the computer was related to other aspects of 
the learning situation. In particular, it is important to see tliis innovation 
as a way of altering the rliythni of student work ac' the char.icler of 
student-faculty interaction. 

Rhythm of Student Work 

One of the curious discontinu/'cs between teaching in the natural 
sciences and in other discipli.ies eonrerns the role of structured lea;ning 
experiences outside the U-iina! „lasbro(^m or lecture presentation. Whereas 
students expect laboratories in many natural science courses, the equiva- 
lent does not usually exist in tiic sixial sciences and humanities. Altliough 
the reasons for this arc obvious, the conseciucnces deserve consideration. 

In most traditional courses in the social sciences and fiumanities, 
students are assigned readings, c^ccasion.illy write papers, and take exams. 
Their contact hours with tlu' faculty are usually lectures or at best seminar 
discussions. One result is that students ivpically lead at an uneven rale. To 
be frank, one very nrjrmat pal tern is a day or two of hurried reading before 
the midterm exam, an ail-nigin exercise in writing a tet .i paper, and a 
couple of days of frantic study before the final exaini{V:!i(jn. In this type 
of course, class .neetings provide an inefiicient means of cliffusii 
information -and a minimal sense of continuity betweef^ the spt. ^ u\ 
attention and energy required of the stuJent. 

Few learning tasks or individual responsibii «;l-s in the modern v.orld are 
like the student's work in courses just described. Instead, one is usually in 
situations that require prolonged and sequential work as a pr(jblem 
unfolds. For this reason, it seems useful to develop pedagogic methods 
which encourage (and require) student^ lo work more continuously on 
structured tasks outside the classroom. 

While the above comments could apply to most C()llege courses in ihc 
humaniucs and social sciences, thev are particularly applicable U) the 
study of political philosophy. One can Mrdly hope to grasp the thought of 
Plato or Marx during an ail-night camming session for a mid-term 



Computcr-Assibtal Instiuciion in Poliiical Philoso()hy 89 



examination. A more continuous process of learning and understanding 
tfu\)Ughout the term is clearly preferable. 

In addition to structuring student reading in time, creating the 
equivalent of short laboraloi y-iyp- experiences, the computer programs 
described below also structure the student's reading in content. By 
emphasizing specific tasks to he completed, and by providing immediate 
feedback on their completion, not only can minimal recognition of 
selected propositions and concepts be improved, but the undersianuing of 
the overall argument of a theoretical work can be clarified. 

Structured materials administered outside Uie classroom also permit 
some of the valuable student-faculty contact hours lo he devolf:d to 
dialogue and discussion or even individual tutorial. The use of computers 
need not, therefore, represent a reduction in student inter act ion with 
faculty, as is sometimes feared. On the contrary, as the data below will 
show, it can improve that interaction by encouraging more coherent 
planninv; of the stuJent's LMining experiences. 

Interactive computer routines have a further virtue, analogous to the 
laboratory in science courses. As Rousseau pointed out, purely passive 
reading is generally unreliable as a method of learning.^ Recent psycho- 
logical research has emphasized the role of active use of cognitive 
information in the process of converting short-term memory lo long-term 
memory. By giving the student something to do after he has read a book, 
and by providing immediate feedback on the accuracy and relevance of the 
student's work, the computer becomes an ef'jctive supplement to 
iradiliontil educational procedures. 

Fin.tHv from the per^:pecti\e ol the faculty member, computer 
rouiini.'* ice developed and tested become a "capital" investment 
which , " ilitates leaching. Coniputer exercises can be stored en magnetic 
tape, di.k, or punched cards to be used when nee-ied; l;!a' trr 'racrprciive 
text-book or a previously given set of lectures, thu> cai" -.r.en bu assigned 
without requiring that the teacher retiiink each altorn.[ivu every time a 
course is i^iven. Hence these devices permit facuity-members to devote 
larger portions of their lime to sp'^cific prol)Iems encourucred b\ students, 
to reconsidering substtintive issue or to resctirch. 

The Context of the Experiment 

Before describing in detail the instructiiuial appiKalions of the 
computer which are the basis of this report, it would he well to mention 
the nature of the courses in which they were introduced. The first 
experiments with the computer in reaching political philosophy were 
conducted in College Course 2, entitled "Science, Revolution, and Moral 
Corruption." An experimentti! interdisciplinjrv' course taught jointly with 
Profp«;sor Joseph Harris of the Department of Physics,^ this course 
introduced numerous innovations in media and pedagogic approach thanks 
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lo a gram trom ihc PrcsidciU's VlmUuiu I und al D<irlnioulfi Cuilcgc. 
SubslanlivcU , Collci^c Course 2 tociiscd on ihc ruKiiion bclwucn sciciKc 
and modern society, particularly a. reflected in ihr writings of Marx, 
Rousseau, Sartre, and Levi-Strauss. 

In this course, CAI was developed to accompany Marx's Communist 
Manifesto and J84-i^ Manuscripts, Rou':>'^cmi''> Firsl und Second Discuurscs, 
Sartre's Search for a Method, and selected readings from Levi-Strau^s, 
Ortega, and other contem[X)rary writers.'' Since College Course 2 was 
offered twice, in the Spring Terms of 1973 and 1974. experience with 
these experimental uses of the computer can he compared in two different 
classes. (Ii)deed, it wa^ only during the second offering of the course that 
the benefits of previously prepared computer exercises became fully 
evident.) 

After the first experiments with comp.i'.er exercises in College Course 
2, they vvere also utilized in Government 97, "The Nature of Political 
Inquiry"- an advanced course on alternative approaches to the study of 
politics taught jointly vvith Prof\ Denis Sullivan of the Department of 
Government. Here the problem wab sufficiently unusual to deserve some 
mention: in surveying scientific as well as philosophic approaches to 
political analysis, it was necessary to give a highly compressed survey of 
the Western tradition of political philosophy. To this end, computer 
exercises were developed to structure and help learn assigned readings 
from Antiphon the Sophist, Plato's Republic, Arhunk's Poh'tics, Hobbes' 
Leviathan, Rousseau's First Discourse, and Marx's German Ideology. 

Finally, similar applications were introduced in Government 96, 
'Politics and Biology "- a new course which surveyed the theoretical anel 
practical interrelations between the bio-medical sciences and politics. 1 his 
course, offered for the first time in the Fall of 1973, was similar to most 
courses in the field of political science with respect to the type of reading 
and analysis required of students. Hence experience with the computer 
applications to be described below has not only been gained in ^hree 
offerings which focused on specific works of political philosophy , but has 
been extended to another course with contemporary, non-philosophic 
readings in the social and natural sciences. 

Computer "Worksheets" in PoFitical Philosophy 

Building upon prior experience with multiple choice or true/false 
quizzes administered with paper and pencil, 1 have developed a number of 
computer "Worksheets" on hImL sophic texts. Those Vu)rksheets. con- 
sisting a series of questions, are distributed to students in advance of 
their reading (Figure 1). All students in the course arc given a special 
computer account number on the Dartmouth Time-Sharing System and 
instructions on how to access a program based on the Worksheet. 

After the student has done the assigned reading, using the Worksheet cjs 
a guide, this computer program is run. The interactive capacities of a 
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limc-shcUing compuiLM syslLMii pLMmil llio bludLMU to onlcr an answer lo 
LMCh qiiL'slion, anil lo receive tmmedialc teeilhaek, noi only on the 
correctness of the answer, Lujl on llie signilicance ol the proposition 
concerned and iis relation to \Uc theory heinj> studied. Pio^raniscan either 
be written so that the stmlent litis only one chance to answer e<ich 
question, or they can permit repealed trials until the ct)rrecl answer is 
given. 

Although the paper cop\ u\ this computer run can be saved for review 
(Figure 2), students are also given a complete •'Answer Sheet" with 
detailed answers to all options (figure 3). Therefore those who wish to 
restudy the Worksheet in detail can do >o at tiieir k'isure. In the meantime, 
computeri/od t ecord-keeptng pro\ides the instructor with a listing ol those 
students who have done the Worksheet, together with their scores and the 
time retjui red t'> run the piogram. Pol most students who have done the 
reading, the computer run usua!l>' takes no more than 5 or 6 minutes. 

wcCt Usr -puMcIs o\ al! student work are maintained by the computer, 
one need merely list the appropriate program to find out which students 
have completed the program and what their scores were (Figure 4). 
Moreover, since the records program indicates automatically the number 
of correct answers to each question, it is e^ ircmely easy to .dcntify items 
which cau>ed difficulty in the class (a task which is very tedious with 
paper-and-pencii quiz/es). f lencc the instructor can distribute a supple- 
mentary analysis >t the class's performance on a VVorksfieet, indicating 
which questions wore frequently missed-and why. 

It should be obvious that computer exercises on assigned reading, like 
other forms of programmed instruction, can be used to improve recall of 
propositions in any discipline. I have experimented with similar Wt^rk- 
shceLs in the Lourse on "Politics and Biology," which included a discussion 
of the legal and political issues arising from new bio-medical tccfinologies 
such as psychosurgery. 

The etfeL:i veness of the computer in administering rather simple 
learning routines would thus seem to be genrrali/able {a a broad range of 
materials not usually viewed as appropriate to programmed instruction. It 
sliould be remembered tha' the computer exercises described above were a 
supplement to traditional educational techniques. Lectures, discussions, 
papers and examinations were not rcp/aced by the Worksheets, nor was the 
Siorc recorded for students in the computer run taken as a component of 
the term grade. Rather, the exercises were graded on a "pass-tail" basis, 
with refusal to lun trie computer programs normall\' tfie '^ole reason for 
failure. (The reason for this policy was to reduce the i/icentive for 
cheating -an issue t(j which I will return in cvaluatini^ the technique.) 

Before evaluating tnesc computer exercises, ii ;i^eds to be addetl Uiat 
the computer was used in sevcial additional wavs, enriching tfie students' 
experience and expanding student-faculty interaction. If several use of the 
computer are introduced s;mu!tanLn;usl\', student interaction with tfie 
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L\)inpuUM' Ml comes k'ss .uliticial. VVIuMCtts .n iiy'lo a[^(ili(.\itioiM)l computer 
inslrucliofi may crcalo fH)stililv aiul tfic appiMiMncc lh.it icchiinlogy Is 
intruiliny in ifiafipropi iatc .iicas, a combination ot rc'alod iisos has a lalhci 
dillcrcnl cflccl (as will he seen in sliiilent evaluations ol these innova- 
tions). Precisely because tfie lollowiiig uses ol Ci)niputei s are //(;/ noi iiMLy 
included in discussions ol CAI, they nitiy l)e ol interest to feader> who 
identify the coni[)uter witfi numerical calcuhition. 

Adclitiotial Uses of Computers in liistruetioii 

Com[)Utcr-Gencralcd Quotations in Classroom Presentations 

By linking a conMniier terminal with a viileo projectoi or I V nionitois, 
it is possil/ie to use a tile n\ qinHations stoicil in the com[)uter as a visual 
displ.iy accompanying a lecture o\ ctassiooni discussion. In political 
philosopliy courses, this \ isual image locuses the stuilents' attention on 
basic passages whicfi U)rm the underlying structure ot th(; lecture. In 
technical terms, visutil display ol the passages being read hy <\ lecturer can 
be described as "redundancy," multiplying the channels through which 
information is conveyed. In infoimation theory, such redumlancy has been 
found in both phonemic contr^ists and the genetic code, and seems to be a 
characteristic of efficient communications systems. Practically speaking, 
this simply means that students are less bored and their attention is 
f( reused more effectively on the substance of lectuie material. 

Some instructors use slides or overhead projectors lor an equivtilent 
effect, but computers fiavc several .idvantages. The file of ciuotatii^is can 
be modified more easily and quickly than new slides could be produced. 
Students can list the file on paper before th..- lecture, or the professor can 
do so and distribute copies to the students, so lecture notes can be taken 
directly on the margins of the print-out (Figure 5). The order of 
presentation of quotations during the lecture can be varied at will. And, 
vhen the quf)tations ,ire macfiine-readabte, students or the instructor can 
select tliem tor display on tfic basis of their topics, keywords, etc. 

Computer Generated Bibliograpfiies 

Bibliographical references a,j usually distributed as part of a course 
syllabus .»r written in a haphazard manner on the blackboard. Neither of 
these devices, however, is entirely satisfactory for the student who wishes 
to do more detailed reading on a topic, particularly if this desire is not 
shared by the class as a whole. Here again, the capacity of computers to 
handle large amounts of qualitative information rapidly can contribute to 
undergraduate instruction. 

Using a procram which alphabetizes entries automatically, annotated 
bibliographies t^^ speutied subjects have been stored on line. Students aie 
invited to list bibliographies of interest at their leisure. Hence 1:mm wIu> 
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seek tiLkliliDiial l>ililio^MphiLtil in,itt'i ial uin ,ict t'ss il Ljiiiikly, without 
taking cl.issruuiTi time lui s(» iluing ami wiiluuil pn^'suiiiinj; thai all 
>IulKmii> will Jo so. 

fhis p(jint is iirpoilaiU. siiuc siuh coinput(.M i/(.Hl liililioi;rat>hics 
(.Mliuontly u'waiJ thus^' stiKioiils with hii^h iiiotivtilioii. Al! too olicti, 
innovations in iLMchin..; aio dcsigiu-J lo ccMTipcl niiniinal woik tiom all 
sluiliMUs, rathor than cncoiit aging Hiithcf stmiy by conccrncLl and 
highly nn)tivalOLj nu'nibL'is ol a class. In the tuiurc, autoniatiL indexing 
and hibliogi apfiical lotiicva! will [HMmil stiid^Mits vsho Arc iwuly lor 
advanced work to jump tium tlu- listings LlcsciihcLl here lo piolcssional 
rciricVtil scr\ li es. 



Conipulcf Message Svsiem fur Student-Faculty Intcraciinn 

In rTU)derate-si/ed cKisses (35 siudenls or iT)oie) and especially in largo 
leciure courses comnuiniLalion between siLiLlenis and faculty is often 
iniiibiieLl b\ ifie apptUeiu di}Ticull\ ol access to tfie piolessiJi. A tew 
stuijenls ma\' cluster ammd Ihc poiliuni lo tisk a question immedialely 
after a leclun'. ,ome will tal e advantage ot leguLir office hours to discuss 
pinlMt'nis infnrn;aii\'. Bui mam studeN;^ .oe' infiilmed from Ttiising points 

in - vi Jiscussion (es[X'cially il ifu", tee! l!ie qiasiion will st'cni 

" ; Mil"}, :here is a geneial sense liia! lacuDv are Ic.a accessible ihan 
'.houiii be 

' dilliLullv h cc^mpoLimled , v a diiierence in [be dtuly ifiyilims of 
.:\: ilislinguishes man\ siudenls from most fticuliy. Whereas 
,irafiKil!\ fiave families and complete iheir day on campus in the 
:ernoon, a large ULimber of sp; ienis lend lo study at nighl. 

curricular activities, spoils, or paii ; erTiplov merit often occun\' 

si"'!. :luiini' ifie dauifne hiuirs wlien [inttessor might be able to 
ml-'! ' •■ 'tb ifu'rTT, in tlie c.\-\ evenirv.'., iiisi as sii.Jcnis are tible [m ; ike 
i;n. .lUT udv aniage o} inh >f mai ui- ■ ■ ^ t. i ^ piL^il ItK ui l \ - niemlief s ih i;ne 
o tfieir ftmiilies. 

i ne cninputer Ctin provide a rTUMMs ol escaping rrt)m iho- 'iisir - is. 
Our two-Wtiy messtige system perrTiilled a in student to co? iicate '.-ith 
l[ie instructor Irom his or lier course user number; tfiese mess.i^L's could In* 
eillier signed or conipleleb' tirTonv rTious. for relmri corTimunicaiion, 
messages could be sent to a single student, any groU[^ or the entire class. 
In this wa\ , il w<is p(.>ssible for students and faculty to c< 'miiiuntcale willi 
each olfier without being simulttineously [Mcseni. 

To provide for rapid replies lo students, each morning ilie file of 
ir^coming messages was listed on a DepartrTieni.il termintil by ifie secreltuy 
{ \ routine itisk ttiking only mo'iuiils), <ind w tis en rny desk wlien I tirrived 
for work. During one term, tis an experiment, I htid ii [portable tcrmiritil 
installed in my fiome. 1'fiis furtfier improved the speeil ot response, since 
student messages could be listeLl boiii ifie lirsi lining in the nKtrning cmd 
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the last thing at night, at times when access lo the computer was 
particularly rapid. 

It might be thought that this system would interpose the computer 
between students and faculty, depersonalizing thejr relations. Just the 
reverse was the case. Many messages were answered in person, and, when 
they were answered via the computer, the exchange frequently led to 
additional conversation between student and faculty before or after class. 
Indeed, the increased communication with students greatly facilitated 
name recognition, so that almost all students who used the two-way 
message system were known by name within several weeks. 

Moreover, the computer facilitated a type of feedback which is 
otherwise rather rare. Many students fell free to make anonymous 
complaints which they would probably nol have communicated directly to 
a professor, and others fell free to sign questions or criticisms (as well as 
praise). In addition, there may be an effect of communicating through a 
computer terminal not entirely unlike the "confessional": one student 
admitted attempting to cheat- and signed his message! 

Computerized Comments on Student Work 

in courses where students are required to do a moderate amount of 
work at the computer, the message system just described can also be used 
for a more substantive form of feedback-namcly grading student papers 
and assignments. If the faculty member has a computer terminal available, 
it is possible to ccr>iment on written work by typing a message directly 
into students' course user numbers. In this way, students need not fy to 
decipher handwritten comments in the mu'-gins, and have access to the 
faculty member's assessment of their work without delay. 

Student Evaluation of Courses 

A final use of the computer might be mentioned, though it does not 
deal with instruction in the narrow sense. In several experimental courses, 
it was felt useful to secure student assessments of the leaching innovations 
used. For this purpose, a student assessment questionnaire was prepared 
(Figure 6); quite obviously, computer handling of the data permitted rapid 
and effective tabulation of the results. Although this is more typical of the 
quantitative analysis for which computers are best known, it does reflect 
the way that a fuller integration of computer technology with under- 
graduate instruction can improve feedback between faculty and students 
(especially when such course assessment questionnaires are anon/mous). 

Description of the assessment questionnaires may be helpful, since the 
data will be utilized below. Students were asked to rate a number of 
aspects of the course on a 0 to 10 scale, with 0 being the "worst" and 10 
the "besl" educational experience in their judgment. Questions on the be'it 
and worst course taker, at Dartmouth were included to provide a base-line 
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for data. Computer runs of the data can readily give not only means and 
medians (Figure 7), but a display of ratings by quartile, a histogram, or, of 
course, more complex statistics (though the latter have not been computed 
because sample sizes are still relatively small). 

Evaluation and Discussion 

Many of the above uses of the computer are applicable in a wide range 
of courses in the undergraduate curriculum. Indeed, the computc-based 
bibliographies and the two-way message system have already been used by 
colleagues in fields such as anthropology and geography. While the 
following evaluation will emphasize the relevance of the computer in 
political philosophy courses, it should be obvious that what is said could 
often apply to other subjects. 

An additional remark is also in order. It goes without saying that the 
flexibility, speed of response, and general accessibility of the Dartmouth 
Time-Sharing System were a major asset in the experimental programs 
described above. Batch-processing computer systems would probably not 
be able to handle most of these teaching techniques as well or at all. There 
is good reason to believe, however, that a time-sharing system which treats 
thn computer as a "free" good, like a library, is at least as efficient as (if 
not more so than) other methods of allocating computer facilities; in 
particular, student use of computer time under this system does not 
appear to inhibit other conventional uses of large computers for research 
or administration.^ 

It is possible that such time-sharing systems will spread through 
American institutions of higher learning. Alternately, smaller time-sharing 
systems-like the PDP-ll-may proliferate for speciali/^ed CAI applications. 
In either case, teaching techniques in which the computer facilitates 
student-faculty interaction may be especially valuable in the future. For 
this reason, careful evaluation of the effects of computer applications in 
undergraduate education is particularly important. Although further 
assessment is necessary, preliminary evidence concerning the effects of the 
techniques described should therefore be o' interest. 

Effects of Computer Worksheets 

It should go without saying that mere "information transfer" is not the 
primary objective of college instruction generally. But, as was arsued 
above with respect to political theory, accurate learning of specific factual 
statements is a necessary prerequisite to understanding, analysis, and 
sound judgment. As such, there are two measures of effectiveness that 
need "'"^ be distinguished more clearly than usual: first, accurate recall (i.e., 
the probability of a "correct" answer); and second, avoiding error (i.e., thr 
probability of "wrong" answers). 
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!n the assessment that follows, it will be assumed that wc seek not only 
to increase the former, but also to reduce the latter. Following the 
Socratic precept that ignorance is thinking one knows the answer when 
one does not,^° avoiding an erroneous answer is considered a desirable 
outcome independent of--and complementary to-correct responses. While 
"Don't Know" is not as desirable as the correct answer, it is surely 
preferable to mistakes."^ ^ 

Only one statistical analysis of the effects of the computer-programmed 
''Worksheets" has been completed. This study concerns a 50-question, 
true/false part of a final examination. The number of students taking this 
exam was only 16, and there is no way to compare the difficulty of 
questions rigorously. Nonetheless, the data give a tentative idea of the 
consequences of introducing computer exercises in courses dealing with 
what are usually called "soft" or qualitative materials. 

Throughout the questionnaire, statements were included in their 
correct forms or were inverted to make false statements in roughly 
equivalent proportions. In Table 1, the percentage of correct and incorrect 
answers, as well as "Don't Know" responses, is tabulated separately for six 
different conditions under which the applicable quotation had been 
presented to the students in the course. The computer exercises described 
above appear to have had a positive impact, striking because they not only 
ma-kedly increased the proportion of correct answers (to 82.6%), but also 
i-educed the proportion of errors (to 9.5%). Hence, on the dual criteria set 
forth above, the use of programmed Worksheets seems to improve the 
cognitive learning of factual propositions without the side-effect of 
increasing errors. 



TABLE 1 

Effect of C'^niputer Worksheets on True/False Final Examination 



Source of Item 
on Final Exam 


Correct 


Answer 
fncorrect 


Don't 
Know 


Number of 
Responses 


Assigned reading only 


63.7 


14.3 


21.8 


160 


Reading and lectures: 








64 


Live 


68.7 


20.3 


10.9 


Taped 


27.0 


31.2 


41.6 


48 


Reading and lecture with 










TV display of quote: 






33.3 


96 


Live lecture 


53.1 


13.5 


Taped lecture 


50.0 


21.8 


28.1 


64 


At! of above (without 








432 


computer Worksheet) 


56.0 


18.1 


75.9 


Any of above with 






7.9 


368 


computer Worksheet 


82.6 


9.5 


Source: Final Examination, Government 96 (Fall. 1973). 
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Qualiialive commcnis on the compuler Workshcels by some of the best 
studenis, moreover, reinforce the jdmillcdiy provisional^^ suitislical data. 
As one outstanding student said, in an unsolicited letter after computer 
exercises in political philosophy; 

I found the computerized worksheets an invaluable and innovative 
guide to some rather difficult reading: they brought out salient 
points in the material, provided immediate feedback, and gave 
additional important distinctions not immediately obvious in the 
material itself (in the form of your ^^Notes" (i.e., explanatory 
material programmed in the computer feedback] ). 

This is not to say that the use of computer Worksheets was considered 
desirable by all students. A fewobiected vigorously to the extent to which 
they were required, in reading philosophic texts, to structure their study in 
terms of the questions on the Worksheets. While these ob)ections indicate 
that this technique effectively requires students to emphasize precise 
learning of specific propositions <ind concepts, they reflect an attitude of 
some students who bitterly rea^nt ihe feeling of beif)g "programmed" to 
do a specified assignment. 

Needless to say, at the limit such ^ feeling reflects a highly 
''subjectivist'* attitude toward study, often found in students who uke 
courses in philosophy precisely because they are noi scientific and allow 
the maximum play for personal interpretation. If the argument at the 
ojtset of this report is correct, such "subjectivism " is undesirable: just as 
one hopes that students will identify typographical or grammatical errors 
in their written work (which cannot be justified merely by the 
conventional excuse "you know what I meant"), so it is impossible to 
enter into coherent discussion of political thought before the objective 
facts of philosophical positions have been learned. 

Even granting this justification, however, it could be asked whether the 
benefits of the programs for computer Worksheets are attributable to the 
Worksheets and Answers rather than to the computer exercises based on 
them. For example, students themselves seem to have found the 
Worksheets more valuable than the experience of answering them on the 
computer: in College Course 2 (Spring 197-;). the hard-copy Worksheets 
and Answer Sheets, which after all could be administered as paper-and- 
pencil exercises, were rated an average of 6.9 (on the 0-10 scale), whereas 
the execution of the computer routines based on the Worksheets was only 
rated an average of 4.7. 

This relatively low rating of the computer component of the exercise 
must be compared, however, to ratings for classroom quizzes. Students in 
College Course 2 rated quizzes given in class, also on a "pass-fail" basis, 
even lower (average 3.7) than the computer routines based on Worksheets. 
Moreover, the computer exercises in Government 96 were rated an average 
of 5.9 (on the 0-10 scale), whereas paper-and-pencil administration of 
similar multiple-choice or true/false items irr another, more traditional 
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political theory course (Government 64, *'Modcrn Political Thought," 
Winter 1974) was rated an average of 6. 

It would appear, therefore, that while many students do not like the 
experience of running computer exercises, these ratings reflect in part the 
distaste for required assignments which influence grades. Computer 
administration of the Worksheets compares relatively favorably with 
alternatives, and is preferable from the point of view of faculty time (since 
paper-and-pencil administration is extremely awkward and time- 
consuming). 

Moreover, despite the difference between ratings of the Worksheets 
themselves and computer routines based on them, many students admitted 
that their experience with the computer was ultimately valuable. For 
example, in Government 96 (in which more than half of the students were 
science majors with considerable computer experience), 17 of 39 students 
said they had learned significantly by using the computer routines. In 
Government 97 this past year, when one of the computer routines did not 
function and students did the Worksheet with paper-and-pencil, several 
students complained, commenting that their interaction with the com- 
puter was **fun." 

It follows that the use of the computer to administer programmed 
instruction in political theory could be considered a matter of con- 
venience. If such materials are well designed, alternative methods of 
administering them would perhaps be equally valuable, provided they 
require an active response by students. Nonetheless, hostility to the use of 
the computer does not seem to vitiate the educational benefits of 
Worksheet exercises. And the computer does have manifest advantages, 
especially in large courses, which counterbalance the fact that students 
prefer more traditional classroom experience such as lectures, and assigned 
reading. 

The complaint that Worksheets unduly "program" student work does, 
however, reflect a danger. It may be wondered whether these exercises 
reduce student reading to a rapid scji'yining of the assigned text in search 
for the "answers" to Worksheet questions. There is no question that some 
students have so responded to the technique. But here a balanced 
judgment is in order: many of those who quickly search the assigned 
reading for answers to the Worksheet would have superficially scanned the 
assignment anyway~or have skipped it altogether. And some who merely 
skimmed the reading for the "answersi," because they were too busy to 
study the work carefully at the time, later reread the text more carefully 
in preparing written papers or examinations. 

In general, comparison of scores on the computer exercises with final 
grades (based on traditional written examinations and papers) indicates 
that there are three rather clearly distinct groups of students. First, those 
who score highly on both the computer Worksheets aA?^ the graded written 
work (the outstanding, highly motivated students); second, those who 
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score highly on ihc computer Worksheets, but did poorly in traditional 
graded work (those who did the computer exercises but little else); and 
third, those who scored low on the computer worksheets, but did well in 
traditional graded assignments. 

Statistical analysis of this finding was not performed because the 
obvious result of a quick survey is sufficient for present purposes: the 
computer Worksheets should not be substituted for traditional written 
work. To do so would punish those students who effectively learn the 
material by other means (including "all-nighters" before the final 
examination), and would reward others who merely skimmed the 
assignment fur the "correct" answers. 

Moreover, counting grades in such exercises would invite attempts to 
cheat: while the computer Worksheets can be changed sufficiently to make 
results of a previous year irrelevant, it is virtually impossible to prevent 
sharing of the completed computer run being used in the course. By 
reducing the benefits of dishonesty as much as possible, the cost of being 
"caught""e.g., for several students who always have identical scores-has 
been sufficient to deter most attempts to cheat. 

If the Worksheets are not highly correlated with final grades and should 
probably not be graded, one might ask: "Why bother?" The answer 
corresponds to the three classes of students described above: first, the data 
and impressions summarized indicate that these exercises were extremely 
valuable for good students, who benefit from the structuring of their first 
reading of a philosophic text. Second, for the average or mediocre student, 
the computer exercise raises the floor of course work, since it decreasei- 
the probability of factual errors even when analysis of the material is 
weak. Third, students who dislike the computer exercises, but are willing 
to study hare: in a traditional way, are not prevented from so doing by 
their mere existence. 

The above considerations would seem to militate heavily in favor of 
utilizing such computer instruction only as a "pass-fail" adjunct to existing 
methods of teaching. As such, they seem to be useful, particularly in 
introducing students to a new work, without in any way serving as a 
panacea. One need not fear, in other words, that this technique will be 
subject to Rousseau's criticism of ^Wulgar authors":^^ insofar as American 
society has adopted the principle of democratizing higher education, the 
least one can say is that the teaching of political philosophy should 
minimize the tendency of students to make factual errors. 

Effects of Computer Quotations on TV 

The positive effects of the computer Worksheets were not equally 
evident in the use of computer generated quotations, exhibited on a TV 
screen. As Table 1 shows, along with this innovation the frequency of 
correct answers was reduced (from 68.7% to 53.1%). However, the use of 
TV display of quotations was also accompanied by a reduction In the 
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frequency of incorrect answers (from 20.3% to 1 3.5%). 

It will be noted that some of the items tested were related to lectures 
pre-recorded on audio-cassettes. While this experiment is not the focus of 
the present report, it seems that the live lecture is vastly superior to the 
prerecorded one: here is an innovation that is accompanied by a reduced 
frequency of correct answers (from 68.7% to 27.0%) mO ir) creased 
frequency of incorrect responses (from 20.3% to 31.2%). Although it had 
not been intended as such, therefore, these taped lectures are a model of 
the kind of technological innovation which should probably not be 
employed, if it has consistently negative consequences like those shown 
above when larger and randomized samples of items are used. 

The potential of the computer-generated display of textual quotations 
is indicated, however, by its effect on the generally ineffective medium of 
pre-recorded lectures: compared to a proposition which was only 
conveyed on a pre-recorded tape, when such a tape was combined with TV 
display, the frequency of correct answers increased markedly (from 27.0% 
to 50%) and the proportion of errors declined (from 31.2% to 21.8%). 
Hence, whether for live or pre-recorded lectures, one finding seems to be 
that this technique does reduce erroneous judgments-though it also seems 
to interfere with correct information recall in live lectures. 

These experiments were conducted without regularly distributing, 
before the class, a xerox copy of the quotation file to be displayed on the 
TV monitors. Subsequently, this has been done on several occasions. In 
fact, what happened in the first use of this technique was that students 
tried to copy the quotations being shown on the TV monitors. Thus their 
attention was divided between following the lecture and copying the 
quotation. By handing out the entire file in advance of the lecture, it may 
well be that one tan overcome the reduced number of correct identifica- 
tions under this method, without necessarily losing the advantageous 
reduction in erroneous answers. Only further research will say for sure, 
though the impressionistic response to the combination of the TV- 
generated signal and the distribution of hard-copy was highly favorable. 

In any event, students in Government 96, in which several quotation 
files were listed or distributed in advance, rated this device on the average 
as 8.0 (on the 0-10 scale); and whereas those in College Course 2 had a 
lower rating for the TV display of quotations (average 6.7), they rated the 
hand-out of a few lecture outline: in that course much more favorably 
(average: 8.5). Hence it would appear t'-ai this technique is most effective 
when combined with advance distributior of a hard copy of the materials 
to be displayed on TV, so that these sheets can be used for note-taking. 

Two Way Message System 

The two-way message system was used in two courses (Government 96, 
and College Course 2 in 1974). In the former, a class of 42 students, the 
message system was frequently used by a large proportion of the class 



103 



Computer-Assisted Instruction in Political Philosophy 101 



TABLE 2 





Use 0 


f Two Way Message System 




Week of 
Term 




Student Messages 




Feculty 
Messages 

(Total 
Number) 


Total 
Number ol 
Messages 


Total 
Number of 
Students* 


Number 
Anonymous 


1 


22 


10 


6 


5 


2 


10 


4 


5 


3 


3 


15 


5 


3 


13 


4 


15 


10 


2 


13 


5 


7 


6 


1 


8 


6 


8 


7 


0 


7 


7 


8 


5 


1 


13 


8 


9 


9 


0 


6 


9 


7 


7 


0 


10 


10 


8 


6 


2 


10 


No date 


2 


2 


0 


0 


Average per week 


1 1.1 


7.1 


2.0 


8.8 



enroMed^°''^'"'^^"^ '^"^"^ for a ten week term742 students 

•I.e. the number of different students who sent signed messages during the week As 
Will be noted, some students sent more than one mesasge a week, espectally toward 
the beginning of the term. y luwaru 



Jable 2) and was highly rated (mean rating 8.39 on the 0-10 scale). In the 
latter, which had 33 students and 2 professors, the system was used by a 
smaller proportion of the class and was less highly rated (6.55 on the 0-10 
scale). Nonetheless, eve.i in the second case, the two-way message system 
provided extremely valuable feedback on a number of problems that arose 
in the course-and helped in many ways to "demystify" the computer. 

Table 2 presents a detailed breakdown of the pattern of use of the 
two-way message system in the larger of the two courses described above. 
This pattern is perhaps ever, more instructive than the fact that there were 
an average of 11 student messages per week (approximately 1 per 4 
students enrolled), and 8.8 faculty replies per week. It will be noted that 
the rate of student messages during the first four weeks of the term was 
approximately twice that of the last six weeks, and that the use of 
anonymo -s comments declined markedly after the Hrst month. Both 
details sugi^est that the two-way message system served primarily to open 
channels of face-to-face communications rather than to substitute for 
them— which was also my impression in teaching the course. 

The two-way message system was particularly effective in overcoming 
the lack of synchrony in the student and faculty work rhythms. Table 3 
indicates the time of day when students used the message system. Only 
43% of student messages were sent between the hours of 10 a.m. and 5 
p.m., when students are most likely to contact their professors by 
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TABLE 3 

Time of Day that Students Used Two-Way Message System 



Time 

Midnight to 3 a.m. 
6 a.m. to 10 a.m. 
10 a.m. to Noon 
Noon to 5 p.m. 
5 p.m. to 8 p.m. 
8 p.m. to Midnight 
No time recorded 

Total 

Source: Government 96 (I 

conventional means. The remaining 57% of student messages were initiated 
at limes when communication between students and faculty is normally 
impossible, many during late evening hours when faculty arc at home if 
not asleep. 

Other Computer Applications 

Of the other experimental uses of the computer, rather little need be 
said. The availability of computerized bibliographies was not generally 
considered of great utility in Government 96, where it was used most 
extensively (average rating 6.39 on 0-10 scale). Of seven such bibli- 
ographies, the average student listed 3.4. But for some students, these 
bibliographies were considered valuable-and, as will be recalled-the 
purpose of this device is to encourage more highly motivated students. 

Comments on student papers entered in student message files were, in 
general, a failure. Students did not have occasion to list their message files 
routinely, and therefore did not profit greatly from this system; since it 
was necessary to announce in class that papers were finished, typed or 
handwritten comments could just as easily have been utilized. In this case, 
the use of the computer has been abandoned, though it might be 
successful in a college environment where all students regularly list many 
messages and announcements stored on line. 

Summary and Conclusion 

A range of computer applications, developed primarily for courses in 
political philosophy and also used in a course on "Politics and Biology," 
have been described. Most important are Worksheets based on major works 
in political theory. Students read the texts with the Worksheets as a guide 
to central issues, then run a computer program in which they answer 
multiple-choice or true/false questions; after each answer, the program 



Number of 
Messages Sent 

8 

5 
10 

36 
23 
25 
A 

111 



Fall, 1973). 
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indicates the '-easons for the importance ol the ciueslion, and the nature of 
the error it one has been made. 

Other instructional a|)plications of the computer included TV display 
of textual citations generated by the computer, a two-way message system 
for student-faculty corrmunication, and computer storage of supple- 
mentary annotated bibliogr -iphies. While fragmentary data Indicate that 
Worksheet exercises on the computer improved recognition of propo- 
sitions encountered In reading and lectures, all of these experimental 
applications served to supplemeni and reinforce -rather than replace -the 
primary educational experiences of .cMding. I'':tures, written assignments, 
class discussion, and final examinations. 

Indeed, one of the most impressive and useful consequences o\ multiple 
computer applications was a generalized familiarity with the Dartmouth 
computing facility for non-science majors. While only a few minutes at a 
terminal were needed to complete each Worksheet, when combined with 
other computer applications, students gained an awareness of the 
limitations and capacity of computer technology. 

In a sense, the computer exercises were what Rousseau called ^'lecons 
dcs choses" (lessons by doing things).^'' For example, the inevitable 
difficulties arising from Interaction with the computer system (occasional 
difficulties of access to a tcrmir.a' program which inexplicably 
malfunctioned, etc.) gave rise to usefu;. K(^.{e imderstanding of the role 
of technology in modern society. Students who had never touched a 
computer terminal began the course by exhibiting great hostility lo the 
experiment - and ended by feeling that they were no longer afraid of the 
computer as such. 

It should go without saying that an understanding of the impact of 
technology on society is particularly important, not only for humanities or 
social science students, but also for the science major. This general 
consequence of using computers In teaching political philosophy may 
therefore be far more Important than the dclpllcd results discussed 
heretofore. All too often, the gap between the so-called "two cultures" is 
decried as t basic weakness in our educational system. Philosophers 
frequently condemn modern science and technology in words, while 
scientists blame philosophers and social scientists for an inability lo 
specify ethical or legal standards for modern technology. 

Ultimately, the fate of Western civilization may well depend on the 
ability of elites and citizens alike to come to grips with the awesome 
problems posed by contemporary scientific advances, particularly as they 
find practical applications. These problems will not disappear, and the 
student should be aware of them even when engaged In the sometimes 
comforting and ennobling study of political philosophy. Whatever the 
other consequences of using the computer when teaching theorists like 
Hobbcs, Rousseau, and Aristotle, Its primary benefit may well be a 
reminder that science and technology condition our attempts to realize the 
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ends which preoccupied Weblcrn p{>litiLal philosophers: freedom, conifnu- 
nity, and, above all, justice. 

FOOTNOTES 

1. Discourse on the Sciences and Arts (1750), in Rousseau's First arid 
Second Discourses, ed. Roger D. Masters (N.Y.: St. Martin's, 1964). 

2. E.g., Roger D. Masters, The Political Philosophy of Rousseau 
(Princeton: Princeton University Press, U)68). 

3. E.g., The Political Writings of /ean /acques Rousseau, ed. C. E. 
Vaughan (Oxford: Basil BIdckwell. 1962), I, M17. 

4. Cf. Rousseau, Emile, lil, in Oeuires Completes de Rousseau (Paris, 
Editions de la Pleiade), IV, 345 n. 

5. Emile, \\\, p. 345 et passim. 

6. Since I had never touched a computer terminal before beginning 
preparations for this course. Prof. Harris was of incalculable assistance in 
introducing me to the potentialities of the computer. Although he is in no 
way responsible for short-comings in the computer applications described 
below, their development would have been impossible without his help. In 
numerous instances, he was able to locate "bugs" which, to this 
non-initiate, had mysteriously afflicted my programs. Thanks for vital 
assistance in computer programming are also due to Seth Masters and 
Elliott Noma. 

7. It is perhaps fitting that the first use of computers in teaching 
political philosophy concerned modern theorists. Nonetheless, the tech- 
nique can be applied equally well to the classics, especially since Plato 
emphasized so clearly the necessity of clear memory in the education of 
the philosopher-king. Cf. Republic, III, 413c-d: "So we must watch them 
straight from childhood by setting them at tasks in which a man would 
most likely forget. . . . And the man who has a memory and is hard to 
deceive must be chosen, and the one who's not must be rejected mustn't 
he?" Trans. Allan Bloom (N.Y.: Basic Books, 1968), p. 92. 

8. The rationale for the choice of Antiphon the Sophist, Aristotle, 
Hobbes, and Marx as "modal" political philosophers, whose writings 
elaborate characteristic alternatives in the tradition of Western political 
thought, is spelled out in Roger D. Masters, "Nature, Human Nature, and 
Political Thought," in Human Nature and Politics, ed. Roland Pennock 
and John Chapman, /Vo/tjos Xl^// (N.Y.: Lieber-Atherton, in press). 

9. Arthur W. Luehrmann and John M. Nevison, "Computer Use under 
a Free-Access Policy,"Sc/e/7Ce, 184 (31 May, 1974), 957-61 . 

10. Apology, 21c-23b; Roussc?.u, First Discourse, pp. 43-44. 

11. Rousseau, E/7?//e, III, p. 4S5. 

12. The chi-square for the last two rows of Table 1 is only 2.54, with p 
^ .3, if each item is treated as a unit and no measurement error or item 
allocation bias is assumed. 
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13. First Discourse, p, 62, 

14. Emile, II (pp, 317, 393-96); III (p, 4A6);ct passim. 
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Figure 1 . A Worksheet 



College Course 2 



73S Masters 



WORKSHEET NO. 2 



ONE: The c^uestion posed by ths Academy of Dijon, which served as the occasion of 
Rousseau's First Discourse, was: 

1 . "What good is it to seek our happiness in the opinion of another if we can find 
it within ourselves?" 

2. "Has the restoration of the sciences and arts tended to purify or corrupt 
morals?" 

3. "What is the origin of inequality among men; and is it authorized by natural 
law?" 

4. "Has the restoration of 'he sciences and arts tended to purify morals?" 
B. "What is the origin and Foundation of Inequality among men?" 

TWO: Rousseau claims that: 

1 . It is a grand and noble sight to see man emerge from obscurity somehow by his 
own efforts. 

2. That he will easily be forgiven for t^e side he takes, 

3. Academies are always concerned with metaphysical subtleties. 

4. Erudition is even dearer to the scholarly than integrity to good men. 

5. Our reasoning does not coincide with historical inductions. 

THREE: For Rousseau, the simplicity, innocence, and virtue of peoples who have 
been preserved from the contamination of vain knowledge are exempiitied Dy: 

1. The Moslems or Arabs. 

2. Athens. 

3. The Tartars. 

4. The first Persians. 

5. The Kingdom of Naples. 

FOUR: For Rousseau, children should: 

1 . Learn how to write verses, as Voltaire lArouet) advised. 

2. Avoid idleness— e.g., by playing tennis, as Montaigne suggested. 

3. Be educated by women, like the Persian kings' education described by Plato. 

4. Be taught by professors like Cicero and Bacon. 

5. Study the writings of the best known philosophers, like Hobbes and Spinoza, 
rather than the works of "elementary authors." 

FIVE: Rousseau argues that: 

1 . Newton was a preceptor of the human race. 

2. Paganism perpetuated the extravagances of the human mind to a degree unique 
in human history. 

3. Ah of our vices owe their birth to the sciences and arts. 

4. Montaigne errc.aously preferred the Laws of Plato to the simple and natural 
regulations of the savages in America. 

5. All of the above. 
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Figure 2. A Computer Worksheet Exercise 



2) WORKS 17 JUN 74 14:21 
YOUR NAME? ROGER MASTERS 

THIS IS A MULTIPLE CHOICE TEST. ANSWER THE FIRST THREE 
QUESTIONS EITHER 1 ,2,3,4,5, OR DK. ANSWER QUESTION FOUR 
EITHER 1,2,3,4,5,6, OR DK. YOUR NAME, USER NUMBER, RESPONSES 
DATE, AND TIME ARE BEING RECORDED. 
QUESTION ONE. YOUR ANSWER? 
? 4 

CORRECT. SEE P. B(3. NOTE THE IMF'LICIT CRITICISM 
OF GENEVA: WHILE ROUSSEAU S.AYS HE WOULO HAVE CHOSEN 
TO LIVE IN A CITY LIKE GENEVA. THE 'TRUE* MODEL IS 
REPUBLICAN ROME. IN FACT, ROUSSEAU'S PRAISE OF 
GENEVA INCLUDES A GREAT DEAL OF CONSCIOUS IRONY, 
ESPECIALLY PP. B4 -6 (WHICH IGNORE THE CONTINUED 
POLITICAL CONFLICTS IN GENEVA DUE TO THE REFUSAL 
OF Tnc MAGISTRATES TO CONFORM STRICTLY TO THE 
CONSTITUTION — SEE PP. 229-30). 

QUESTION TWO. YOUR ANSWER? 
? 2 

NO. SEE P. 92: THE MDRE NEW KNOWLEDGE Wl- ACCUMULATE. 
THE MORE WE DEPRIVE OURSELVES OF THE Mt'ANS OF 
ACQUIRING THE MOST IMPORTANT KNOWLEDG,: OF ALL.' 
NOTE HOW ROUSSEAU QUESTIONS THE POSSIBILITY OF 
BENEFICIAL PROGRESS. 

QUESTION THREE. YOUR ANSWER? 
? 5 

CORRECT. SEE P. 129. HOBBES WAS CORRECT TO 
REJECT THE TRADITIONAL NATURAL LAW TEACHING 
ACCORDING TO WHICH VIRTUR DEPENDS SOLELY ON 
REASONING. 'HOBBES DID NOT SEE THAT THE SAME 
CAUSE THAT PREVENTS SAVAGES FROM USING THEIR 
REASON, AS OUR JURISTS CLAIM, PREVENTS THEM 
AT THE SAME TIME FROM ABUSING THEIR FACULTIES 
AS HE HIMSELF CLAIMS.' (P. 129). MEN IN THE 
PURE STATE OF NATURE ARE TOO STUPID TO BEHAVE 
IN THE MANNER HOBBES DESCRIBES AS THE 'NATURAL 
CONDITION OF MANKIND'-AND. IN ADDITION. 
HOBBES REJECTS THE SENTIMENT OF PITY AS A NATURAL 
CHECK ON THE DESIRE FOR SELF-PRESERVATION. 

QUESTION FOU.^. YOUR ANSWER? 
? 2 

CORRECT. NOTE THAT. ON THIS POINT. ROUSSEAU'S 
POSITION IS IDENTICAL TO THAT OF HOBBES (CF 
QUESTION TWO. E.) 

END OF WDRKSHEET 
YOUR SCORE WAS: 

3 CORRECT 1 INCORRECT 0 DK 
« 2 OUT OF 4 

2.622 SEC. B6 I/O 
2) READY 
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figure 3- Answer Sheet for a Worksheet 



College Course 2 



74S Masters 



ANSWERS TO WORKSHEET NO. 2 



Question ONE: 

1. No. This is a question posed by Rousseau himself at the end of the First 
Discourse (p. 64). Note that, in terms of Rousseau's conclusion, "virtue"-i,e., the 
standard of good "morals"-is a "sublime science of simple souls" whose principles 
are "engraved in all hearts": it is not necessary to study science or philosophy in 
order to be virtuous. 

2. No. This is the question of the First Discourse as it is RESTATED by Rousseau 
(p. 34). Note that in restating the Academy of Dijon's question, Rousseau changes it 
by adding the alternative that the "restoration of the sciences and arts" may have 
tended to "corrupt morals" rather than "purify" them; tacitly, he accuses the 
Academy of having biased the issue by the way tt posed the question, 

3. No. This is the question posed by the Academy of Dijon in 1754, which 
became the subject of Rousseau's Second Discourse (see p. 99). 

4. CORRECT. See p. 31 (title page of First Discourse) . 

5. No. Compare the title of Rousseau's Second Discourse (p. 101 ), which-like 
the First D/scot/rse— involves a subtle change in the question posed hy the Academy 
of Dijon; in this case, Rousseau adds a reference to the "foundation" of inequality, 
and deletes the question relating to the possibility that inequality is "authorized by 
natural law." 

Question TWO : 

1. CORRECT. See p. 35. Rousseau never denies that, in a sense, the process of 
scientific and artistic development in the West since the Renaissance is superior to the 
superstition and barbarism of the Middle Ages. Indeed, Rousseau asserts that "the 
peoples of that part of the world which is roday so enlightened lived, a few centuries 
ago, in a condition worse than ignorance" {p. 35). The moral corruption procluced by 
science is not the only source of a "condit-or^ worse than ignorance." 

2. No. See p. 33: Rousseau says expliciL-y the reverse {"I foresee that I will not 
easily be forgiven for the side I have danid to take,") Indeed, many critics in 
Roussea'«'s day— and since— have confirmed this prediction: as Rousseau well 
understoo.d, he was attacking a central belief in Western culture. 

3. No. See p. 33: according to the Preface, "This discourse is not concerned with 
those metaphysic^al ^ubieties that have prevailed tn a\\ parts of learning and from 
which the announcements of Academic competitions are not always exempt. . . ." 
Apparently, the Prize Competition of the Academy of Dijon is an exception to a 
trend "m all parts of learning" (though of course one could read the above sentence 
to mean that the "Academic Competitions" are not "parts of learning"). In any 
event, Rousseau goes on to add at once that, in this case, the Academy of Di|on has 
raised the issue of "one of those truths that concern the happiness of mankind." 
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Figure 4. Computer Listing of Student Records 



.CUD LioTER.RUN 

2) LISTER 17 JUN 74 14:02 

NAME OF RECORDS FILE? RECORDS 

1 



2 3 4 



MINUTES 



HO\J99QO^ 

HDU99(W2 JACK BARRETT i 1 

HDU990Q3 ELLEN M. BERES 1 1 

HDU99(W4 JEFF BOLTON 1 1 

HDU990Q5 CRAIG BROWN --1 1 

HDU99006 

HDU99(3a7 DAVE FARMER 1 -1 

HDU990Q8 

HDU99(3a9 PAMELA GERVER -1 1 

HDU99010 

HDU99011 

HDU99012 

HDU99013 

HDU99014 

HDU99015 GEORGE C. JEPSEN 1 1 

HDU99016 DAVID KEPES 1 1 

HDU99(J17 BRIAN KINGSBURY 1 \ 

HDU99018 DWIGHT KINGSBURY 1 1 
HDU99(319 KEVIN MCGILLICUDDY 1 1 
HDU99020 JIM MIERS -1 1 

HDU99021 THOMAS N. NlCHOLSON-1 1 
HDU99022 HEATHER PETERSON 1 1 
HDU99023 MARK RHODES -1 1 

HDU99024 MICHAEL ROITMAN 1 1 

HDU99025 LG ROSENSHEIN -1 1 

HDU99026 
HDU99027 
HDU99028 

HDU99(329 REGINALD L.THOMAS 1 -1 
HDU99030 STUART WEE KS 1 1 

HDU99031 

HDU99032 NEIL KORSEN 
HDU99033 DAVID LOCKARD 
HDU99034 
HDU99035 
HDU99036 
HDU99037 IRIS 
HDU99038 JOE HOFFMAN 
HDU99039 
HDU99040 

HDU99041 ROGER MASTERS 
HDU99042 
HDU99043 
HDU99044 
HDU99045 

TOTAL CORRECT 



EXERCISE NOT DONE 

1 1 4 

1 1 3 

1 1 3 

1 -1 7 

EXERCISE NOT DONE 

1 1 5 

EXEFTCriSE NOT DONE 

1 -1 3 

EXERCISE NOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 



SCORE 

4 
4 
4 
0 



4 
3 
4 
4 
3 
4 
3 
4 
4 
3 
3 



1 -J 
1 1 



EXERCISE KOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 
1 4 
1 4 
EXERCISE NOT DONE 



1 1 4 
-1 1 4 

E/ i-u' NOT DONE 
EX : ' : NOT DONE 
EXE;. NOT DONE 
1111 3 
-1111 5 

EXERCISE NOT DONE 
EXERCISE NOT DONE 
0 0 0 0 4 

EXERCISE NOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 
EXERCISE NOT DONE 

16 20 21 21 



1.197SEC.37 I/O 
2) READY 



MEAN 
S.D. 



= 2.66667 
■■ 1 52277 



4 
4 
4 
4 
4 
2 
2 
4 
0 
4 
2 
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Figures. Computed 

JEAN-JACQUES ROUSSEAU 

DISCOURSE org THE 
SCIENCES & ARTS 



CLAUDE LEVI-STRAUS3 
"A WRITING LESSON" 
TRISTES TROPIQUES, CH. 28 



ROUSSEAU'S CRITIQUE OF 
CIVILIZED SOCIETIES 



@ 

IF I WERE THE CHIEF OF ONE OF 
THE PEOPLESOF AFRICA. I 
DECLARE THAT I WOULD HAVE A 
GALLOWS RAISED ON THEJiHON. 
TIER OF THE COUNTRY. wFfERE I 
WOULD HAVE HANGE D WITHOUT 
REPRIEVE THE FIRST EUROPEAN 
WHO DARED ENTER AND THE FIRST 
CITIZEN WHO WOULD TRY TO LEAVE. 

ROUSSEAU, DERNIERE REPONSE 
(1752) 

@ 

THE EXAMPLE OF SAVAGES. WHO 
HAVE ALMOST ALL BEEN FOUND 
AT THIS POINT. SEEMS TO CONFIRM 
. . . THAT THIS STATE IS THE VERI- 
TABLE PRIME OF THE WORLD; AND 
THAT ALL SUBSEQUENT PROGRESS 
HAS BEEN IN APPEARANCE SO MANY 
STEPS TOWARD THE PERFECTION 
OF THE INDIVIDUAL, AND IN FACT 
TOWARD THE DECREPITUDE OF 
THE SPECIES. 

ROUSSEAU, SECOND DISCOURSE 



ted Quotations 

LEVI-STRAUSS' STUDY OF 
PRE-LITERATE SOCIETIES 



@ 

IT WAS NOT A QUESTION OF KNOW- 
ING SP^CIFICTHINGS,OR UNDER- 
STANDING THEM. OR KEEPING 
THEM IN MIND. BUTMERELYOF 
ENHANCING THE PRESTIGE AND 
AUTHORITY OF ONE INDIVIDUAL- 
OR FUNCTION-AT THE EXPENSE 
OF THE REST OF THE PARTY. 

LEVI-STRAUSS. 
A WRITING LESSON 

@ 

THE EFFECTS OF THE 



DEVELOPMENT OF THE 



_SaENCESAND ARTS 

@ 

NEED RAISED THRONES; THE 
SCIENCES AND ARTS HAVE 
STRENGTHENED THEM. 

ROUSSEAU, FIRST DISCOURSE 

@ 

THE DEFECT OF WRITING 

@ 

THIS DISCOVERY . . . WILL CREATE 
FORGETFULNESS IN THE LEARN- 
ERS' SOULS, BECAUSE THEY WILL 
NOT USE THEIR MEMORIES. 

PLATO. PHAEDRUS 



113 



Computer-Assisted Instruction in Political Philosophy 111 



Figure 6. Part of Course Assessment Form for Students 



DARTMOUTH COLLEGE 



Government 96 



74F: Masters 



COURSE ASSESSMENT QUESTIONNAIRE 



Please answer each of the following questions by writing in the blanks a number 
brtween "0" and "1 0." representing your mea:>ure of the effectiveness of the aspects 
ot Governnnent 96 listed below. (0 meaning useless or harmful, 10 meaning the best 
educational approach imaginable). To provide a base-line for comparison, you are 
asked to rate-on the same scale— the best and worst courses you have ever taken at 
Dartmouth (without naming them of course). If you have no opinion on a question, 
answer "/ /. " 

For the "Yes-No" or "More-Same- Less" subquestions just check the appropriate 
box. If you have no opinion on THESE questions, leave blank. 

ANSWERS WILL NOT BE READ OR ANALYZED UNTIL AFTER COURSE 
GRADING IS COMPLETED. 

Course User Number 

RATE THE FOLLOWING ASPECTS OF CLASS MEETINGS: 
1 . Music played before class starts. 

2. Use of Computer quote files, projected on screen DURING Professor Mas- 
ters* lecture presentations. 

(Note; Your rating here should deal solely with the experience of seeing 
headings of lecture outline and quotations during the class— do not 
confuse this rating with rtem 14.) 

3. Slides chosen to illustrate lectures. 

4. Audio-visual lecture-presentations by Professor Masters (as a whole). 

5. Traditional lectures by Professor Masters 



a. Would you have preferred a straight lecture course? Yes No 
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Figure 7. Computer Analysis of Student Course Assessments 



VARIABLE TYPE 


MEAN 


MEDIAN 


NO ANS 




1 


0-10 


7.22 


7 


2. 


Music before class 


2 


0-10 


6J96 


7 


1 


Use of Computer Display 


3 


0-10 


8.06 


8 


0 


Choice of Slides 


4 


0-10 


7.76 


8 


0 


Audio-visual presentations 


5 


0-10 


5.83 


6 


1 


Traditional lectures 


85 


0-10 


8.52 


8 


1 


Best course at Dartmouth 


86 


0-10 


6.25 


6 


21 


Best course elsewhere 


87 


0-10 


2.19 


2 


4 


Worst course at Dartmouth 


88 


0-10 


1.75 


2 


21 


Worst coutse elsewhere 


89 


0-10 


7.46 


8 


1 


Rating Government 96 



VARIABLE 85 (Rating of "Best Course taken at Dartmouth") 
0 1 23456789 10 NA 



3 

2 2 
s 4 2 



1 
1 
1 

^ 1 



Note: Diagonal represents ratings; of students for whom Government 96 was 
equally rated with "best course" taken at Dartmouth. Ratings below the 
diagonal thus reflect judgments that Government 96 was better than any 
other course taken by the student completing the assessment. 
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Chapter 6. 
Teaching Principles and 
Methods with CAI 

Jonathan Pool 

"Why do you want to teach political science with CAI?" This is the 
first question that the staff of the SUNY at Stony Brook CAI Laboratory 
put to three political scientists in 1970, when they asked about the 
possibility of using the lab to teach 'Introduction to Political Analysis," 
the basic course in methodology and philosophy of political science. Why 
CAI? To be truthful, the reasons for our interest in CAI were not very well 
thought out at the time. In retrospect, they were: 

1 . Stony Brook had a CAI lab. 

2. The lab was not yet operating at capacity. 

3. The course had not been offered before and had no crystallized 
syllabus. 

4. The three instructors were committed to designing a fresh approach 
to the teaching of the subject. 

5. There was a general ethos of experimentation and innovation in the 
department under its new chairman. 

6. ^ The three instructors were interested in CAI and its potential for 
individualized, interactive instruction. 

7. The subject of philosophy of social science and basic methodology 
seemed suitable for CAI, because of the prevalence of definitions, 
procedures, and quantitative problems, which could be the bases for 
questions with correct and incorrect answers subject to automatic, 
objective diagnosis. 

The last reason was enough to elicit guarded sympathy from the 
director of the campus CAI lab. She was aware that faculty demand for 
the facility would soon outrun the available terminal-hours, and she 
wanted to make sure that the lab would be put to the best possible use. So 
she put question number two: "What are you going to do with CAI that 
you can't do with conventional methods? After all, we can't waste 
expensive computer time doing what a programmed textbook could do as 
well." 
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Our answers lo this question were based more on hope than on 
experience. First, we could route the student in more complex ways by 
computer than in a programmed textbook or workbook. Second, we could 
program the computer to analyze students' answers, rather than iust 
compare them wilh a single correct answer. And, third, wo could use the 
computer »o keep records of how the students were doing, so the faults in 
our instructional programs could be corrected. This would be too 
expensive if piles of workbooks had to be collected after use, and every 
student entry coded and punched for analysis. 

Tentatively convinced, the lab director said we could begin and offered 
the full cooperation of the staff. By the time we began to use CAi the 
course had been taught one semester, and the instructors had some ideas 
about the role the computer might play. At the outset, a decision was 
made to give CAl one particular )ob in the course: making sure that the 
students really knew and understood what ihey supposedly knew and 
understood. CA! was consciously built in as the "third force," after (1) 
class discussions and (2) textbook reading. Students came to the lab ' t 
one of their three weekly class sessions, and everything they were taught m 
CAi had already been discussed in class and in the assigned reading. These 
three components of the course were fully integrated, in part because the 
textbook was being written simultaneously with the CAI lessons by the 
instructors themselves. If, instead, we had selected an existing textbook 
for the course, we still could have produced a coordinated set of CAI 
lessons for that book in agreement with its author and publisher. 

The need for a "third force" in our methodology and philosophy-of- 
science course was clear. Like our colleagues, we had great difficulty 
teaching abstractions. And even when students did successfully memori/e, 
in words, the definition of "definition" or the distinction between a row 
And a column percentage, there was no certainty that they had learned 
anything meaningful or useable. 

Thus motivated, the author of this chapter took on the job of 
producing some CAI material that would help students master the content 
of the course. With no prior programming experience other than an ability 
to use DATA-TEXT and SPSS, he was happy to hear that a CAI author's 
package was available on campus to make his job easier. The package 
contained a primitive version of the CLUEGEN procedure described in 
Chapter 3, and this is what was used. Since that chapter discusses what it is 
like to write CAI material with such a package, the present chapter will 
focus on the material that resulted. 

Four Kinds of Tasks 

Our use of CAl to make sure students knew and understood the subject 
involved four approaches. At the first and simplest level, we tested the 
students' ability to reproduce something which they were supposed to 
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know. A typical case was a definition, which appeared on the screen with a 
blank in place of the term that was being defined. The student, who had 
already seen this definition in the textbook, had to supply the missing 
term. Multiple choice questions were also given at this level, where one of 
the answers reproduced what had been read in the textbook. This 
approach corresponds to the basic one described by Masters, oriented 
toward correct factual knowledge. 

An example of a reproduction question as it appeared on the screen was 
the following: 



A(n) relational property is one that (y,x) has 

whenever (x.y) has it. 

□ 



The rectangle, called ihc "cursor," indicates that the computer is waiting 
for the student to type an answer. As (s)he does, each letter appears inside 
the cursor, which moves one position to the right. In this example the 
student is expected to type in the word "symmetrical"; this definition has 
appeared in the textbook, so this CAI item is merely checking to see 
whether the student remembers which term is defined this way-if not, the 
student will be reminded. 

The second kind of material was recognition exercises. Here students 
might be asked to observe a series of items, while keeping a particular 
distinction in mind. When an item appeared, they had to indicate which of 
the distinguished concepts the item was an example of. Alternatively, they 
might be given a set of things and asked to pick the one that exemplified a 
particular concept. A set of generalizations might be presented, for 
example, with the instruction to indicate which was the probabilistic one. 
Or two statements containing partly similar wording were given, and the 
student was asked whether they referred to different objects, different 
properties (attributes), cr both. 

An example of a re^^ognition item was the following: 
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"Last year most countries in the world experienced inflation." 
□ 

•u,s^» 



This was one item of a series, whose instructions were to decide whether 
each generalization that appeared on the screen was "universal" (u), 
"semi-universal" (s), or "descriptive" (d). Students typed the letter 
standing for the answer they thought was correct. The verbal definitions of 
these three types of generalization had been given in the textbook, and the 
students had already shown (in exercises of the previous type) that they 
remembered these definitions, but now for the first time they were asked 
to recognize actual cases as falling into one of the three types. 

Thirdly, there were practice components that gave the student the 
chance to ask for things fitting certain descriptions. Whenever a conceptual 
distinction was being taught, there were practice opportunities in which 
the student could choose one of the concepts and see an instance of it. For 
example, logical relationships among sets were taught in part by a 
sequence which began as follows: 



1 . All objects with a have 6. 

2. Most objects with a havis b. 

3. Some objects with a have 6. 

4. No objects with a have 6. 

□ 



Whichever number the student typed in, the corresponding (modified 
Venn) diagram appeared immediately below. Typing "I " would transform 
the screen into: 
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1. All objects withd have/?. 

2. Most objocts with a have 6. 

3. Some objects with a have 6. 

4. No objects with a have/?. 
1 



b a 



Students were also given chances to "change" what they saw on the 
screen. A generalization appeared, for example, and students were asked 
whether they would like to change its '•domain," its "force," or both: 



"No U.S. Senator today favors abolishing the Senate." 
□ 

•d.f^.go' 



If the student typed "d," asking that the domain be changed, the original 
generalization was crossed out and another appeared underneath, dealing 
with a different domain (set of objects) but otherwise identical: 





'-^^k>4J^ Se«irtOf 4odav^aver^-abe HsWftg-t he -Senate .- 
d 

"No legislator favors abolishing his legislature." 
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The screen then returned to its former display, and students could 
continue typing change commands, repeating the same ones if they 
wished. When ready to go on to the next item, they typed "go." 

Finally, we used CAI lessons to teach the application of principles. This 
is clearly the most demanding test, not only for the student, but also for 
the author of CAI lessons. It is here that the capacity of CAI as a medium 
has its limit. But we have far to go before we as authors reach that limit. 
An archtypica! application question might be: *'Give an example of an 
ordinal variable." No machine can be programmed to recognize all the 
right answers and reject all the wrong answers to this question. But some 
less creative application skills can be taught via CAI. Table reading is one 
of the hardest skills to acquire, even though the possession of this skill is 
often erroneously taken for granted. Since we hypothesized that the skill 
could be developed only through extensive practice rather than explica- 
tion, CAI was an important component in our strategy for teaching this 
skill. Our application exercises with tables involved the continued display 
of a table, accompanied by a series of questions or descriptive generali- 
zations. The student's task was to inspect the table and infer from it two 
things: (1) whether it was possible, on the basis of the information in the 
table, to answer the question or determine the truth or falsity of the 
generalization on the screen; (2) if so, what the question's an-wer was or 
whether the generalization was true or false. An example is provided by 
the following display: 



Race of Executed 



Period 


White 


Btacic 


Other 


Total 


1930-39 


827 


816 


24 


1667 


1940-49 


490 


781 


13 


1284 


1950-59 


336 


376 


5 


71 7 


1960-69 


98 


93 


0 


191 



□ 

Was anyone executed in 1969? 



The instructions were to give the answer if the answer could be 
determined, and otherwise to type in "?." The question shown above was 
one of 16 consecutive questions all based on the same table. 

Beyond this paradigm, considerably more creative exercises involving 
tables could have been written. A table with labeled row and column 
variables but with blank cells could be presented, and students asked to fill 



121 



Teaching Principles and Methods with CAI 119 



in the ceils and margins with absolute numbers and row, column, and total 
percentages. The computer could be programmed to check the figures for 
internal consistency. Students could be required to make necessary 
adjustments and then be asked some questions calling for use of their own 
figures and requiring that they know whether row, column, or total 
percentages were called for. 

Elsewhere in the course the computet presented items each containing 
two generalizations dealing with the same subject, and asked students to 
determine whether these were just different formulations of the same 
generalization or were substantively different. We found that this was by 
no means a trivial exercise. Students were often initially stumped by items 
like the following: 



More Communist than Democratic Party members are FBI 
agents. 

•V,n* 

□ 

If X and Y are the sets of Communist and Democratic Party 
members, respectively, then the proportion of elements being 
FBI agents is greater for X than for Y. 



Another example of CAI in the teaching of application skills was the 
presentation of a Venn diagram and a generalization, with the problem of 
determining whether the diagram could or could not represent the 
generalization. These problems, too, could be difficult. In the following 
example, one of the lettered boundaries encloses the set of gun-owners, 
one the set of liberals, and one the set of suburbanites. Students first 
indicated whether this diagram could possibly represent the generalization 
shown, and, if so, they specified which boundary bounded which set. 



□ 

"Every liberal who is not a suburbanite is also not a gun-owner." 



122 



1 20 Tcp^.ning Principles and Methods with CAI 



Venn diagrams like those shown above turned out to be challenging not 
only to our students, but also to us. We were using a small computer, an 
IBM 1800, with hard-wired IBM 1510 terminals. Our CLUEGEN packaged 
procedure was generating code in a CAI language called COURSEWRITER 
II. This system allowed the author to display diagrams, but certainly did 
not facilitate such displays. Each diagram had to be decomposed into 
vertical or horizontal dashes, which had to be punched on cards in 
succession together with information about their locations. Vertical lines 
required specifying a backspace and a line change after each (vertical) 
dash. Rounded corners required devising new characters, with the shapes 
of portions of circles, and adding them to the catalog of characters, since 
the whole system was oriented toward producing strings of letters, 
numbers, and punctuation marks, rather than diagrams. All this took many 
hours. Had we been writing on the PLATO system instead, for example,- 
we could have used the "draw" and "circle" commands in its TUTOR 
language to produce the desired diagrams in a fraction of the time.^ 



Responding to the Student's Response 

Up to now, just about ail of what has been described could have been 
in a workbook rather than in a set of CAI lessons. What distinguishes and 
justifies CAI most is what happens after a student has given an answer to 
the question or problem appearing on the screen. In our course, the 
computer's response to the student's response-i.e. the feedback-m;iJriI/ 
took the form of clues that were displayed after the student gave a wrong 
answer. 

Suppose the purpose of our sample item is to make sure the student 
remembers one technical term, used in the textbook, such as "dictionary 
definition." In this case the initial display might be: 



A(n) is a statement giving the meanings a terti 

ordinarily has in various contexts. 

□ 



A variety of clues might come to mind, such as: 
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Remember what kinds of statements give the meanings of 
terms. 



We find such statements in a particular kind of book. 



d 



d 



These or other clues could, in the desired order, be displayed if the student 
continues to give wrong answers. 

But one possible type of clue consists in a modification of the original 
problem itself. By making a clue appear in the same place as the problem, 
the author can, in effect, erase and replace the problem. Such a clue could 
be: 



This gives part of the answer and hence narrows ih*^ question. As soon as 
this clue has replaced the heading on the screen, the previously specified 
right answer is, of course, no longer adequate. *'Dictnnarj' definition'* 
should still be allowed as a right answer, in case the student has not 
noticed or appreciated the change at the top of the screen; hut fron: now 
on the single word "dictionary** must also be accepted a^ the (m^m) 
correct answer. For this purpose, CLUEGEN's "temporary correct 
answer" routine is used. Subsequent clues may again appear underneath 
the answer zone, leaving the new question intact, e.g.: 



Atr.l definition is a statement giving the mean* 

ing«; a term ordinarily has in various contexts. 



But what do we do about the student who at the very beginning 
recognizes that a definition is being described, and v/ithout bothering to be 
more specific types "definition" as the answer? The author must 



A(n) definition i? a statement giving the 

meanings a term ordinarily has in various contexts. 



□ 



One of these; 



dictionary 
stipulative 
prescriptive 
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anticipate this, for otherwise students who give this partially correct 
answer mighi be greeted with a general clue like: 



Remember what kinds of statements give the meanings of 
terms. 



This is intended to remind the student of precisely that part of the correct 
answer which (s)he in this case has just provided. Here the unintended 
effect would be to make the student question whether there was any 
correctness at all in an answer of "definition." A way out is to provide a 
response-specific clue, keyed to a response of ''definition." 



Yes, but can you be nore precise? 



might do the trick. If the author is providing for scorekeeping and believes 
that no points should be taken off for responding with "definition" alone, 
(s)he simply assigns a "0" to this response-specific clue as its contribution 
to the score. 

items of this type (reproduction) are only the beginning of an effort to 
make sure that the student understands the different types of definitions. 
A series of recognition items can be provided, each of which gives an 
example of a definition and asks the student what kind it is. The initial 
display of such an item might look like this. 



"By 'law' i shall mean a governmentally adopted and promul- 
gated normative rule with or without sanctions." 

□ 

•d.s.p.x* 



The conventions 



d = dictionary definition 
s = stipulative definition 
p = prescriptive definition 
X = not a definition 
•...• = response alternatives 
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would have been explicated in prior instructions, as would the task for this 
set of items: determining which type of definition each statement is, if it is 
a definition at all. 

Items of this sort can make good use of response-specific clues. One 
type of such clue would give an example of the kind of definition the 
student erroneously specified, for comparison. Thus, if in response to the 
above stimulus the student typed "d," (s)he might see the following clue: 

Sorry, a dictionary definition might be: 

"A law is a factual regularity in science, but a governmen- 
tally adopted norm in politics." 



Practice items could provide terms and ask which kinds of definitions 
of those terms students would like to see. By typing "d," they would bring 
forth a dictionary definition, and so on, and they could repeat these 
requests in any order, receiving new examples from the bank, until they 
felt they understood the differences. 

Finally, a more complicated exerciso to test the ability to apply these 
concepts could present a set of three definitions together in a single item. 
The student could be asked to identify the two definitions belonging to 
the same type. Some of the items could be so written that the definitions 
that were identical in type were quite different in content, while those 
i-'-' nitions different in type were similar in content. Students could thus 
be trained to look for the less obvious aspect of each definition that 
determined its logical type, and appropriate clues could be fashioned for 
this purpose. 



What CAI Taught Us 

Our experience at Stony Brook was that a multi-faceted approach to a 
topic like the different kinds of definitions yielded quite satisfactory 
results. The bulk of the students emerged with at least a temporary 
mastery of an important conceptual distinction which otherwise would 
have been a dim recollection of just another professor talking at them (or 
even to himself) from the front of a room. The students themselves 
appeared, to appreciate the help they got from CAI: in a confidential 
cjjestionnaire at the end of each semester they almost all said that the 
hours allocated to CAI should be either maintained or increased, but not 
reduced. They compared CAI quite favorably with the other modes of 
instruction used in the course. 

With a subject such as methodology and philosophy of science, student 
abilities vary greatly within the same class. This fact provides an important 
justification for an instructional medium like CAI that gives each student 
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personal attention and lets each proceed at a different pace. We, like 
Coombs, observed that ihe fastest students finished the CAI lessons about 
three or four times as quickly as the slowest students. This was natural, 
considering that an item that was immediately answered correctly would 
terminate and never appear again, while one that was consistently 
answered wrong continued through the whole batch of clues and then was 
repeated two more times, again with clues. The slow students could keep 
up with the class if they spent more hours per week in the lab, and in this 
sense a CAI component helped counterbalance the speed bias of other 
evaluation techniques. But after a couple of semesters the CAI lab had 
become so heavily booked that in practice there was almost no time 
available for catch-up sessions. Thus the slowest students simply didn't 
finish. 

CAI in our course seemed to provide a strong motivation for doing the 
assigned reading on time. Students attempting a CAI lesson without having 
read the corresponding chapter found the lesson embarrassing and 
meaningless and appeared conscious of their ignorance. Those who had 
done the reading found the lessons rewarding, both In the sense of 
receiving one perfect score after another and in the sense of building 
perceptibly on top of their textbook knowledge. 

The size of our class at Stony Brook forced us one semester to double 
students up at terminals, and the result was so positive that we never tried 
to return to a singles-only policy. Seating two students lo a terminal and 
allowing them to discuss the questions and answers appeared to provide 
companionship, a teamwork spirit, and a convention-floor rather than 
outer-space atmosphere. Teams tended to get the right answer more often, 
although their discussions made them take longer than singles. For the 
author, pairing the students had the Irreplaceabio advantage of letting him 
actually hear the students think. He did not merely have to guess why they 
made the errors that turned up on the performance tape. Walking around 
the room, he heard them explain to each other the rationales for the (right 
or wrong) answers they were contemplating. Students also explained to 
each other the meanings of the clues as they appeared, helping the author 
discover where he was being misunderstood. 

As a CAI sequence goes through more semesters of testing and revision, 
the importance of listening to this student cogitation declines. It also 
becomes increasingly likely that the instructor will have enough confi- 
dence in the CAI lessons to begin using CAI scores as a component of the 
course grade, if this is deemed desirable in the first place. But when this is 
done, the risk of student complaints against pairing on the grounds of 
grade damage ("You assigned me a dumb partner.") rises. Thus, a return to 
single work might be best after the developmental stage, if grading will be 
partly based on CAI scores. 

On the other hand, the decision to grade students on CAI work, and 
how to do so, should not be made lightly. If those making the fewest 
errors get the best grades, exploratory answers will be discouraged and the 
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airs-well-that-ends-well aspect of CAI, which allows some students to 
make up in perseverance what others have in brilliance, will be vitiated. 
Further, instructors may find themselves arguing defensively with students 
over the justice of a particular score, when instead they ought to be 
welcoming student suggestions for improvements in the CAI material. 

In the long run, it is important to regard any set of CAI lessons as 
always under development. The number of instructional experiments that 
can be conducted In a single course is limited only by the number of 
semesters it is taught. Packages like the one we used at Stony Brook, which 
collect all performance data for computerized analysis and allow alterna- 
tive versions of a lesson to be prepared with ease, make a strategy of 
perpetual testing and refinement not only desirable, but eminently feasible 
as well. 

A strategy of continual development depends, of course, on continuity 
in the computer facilities that are available. This, however, is not a 
common feature of the contemporary university. At Stony Brook, at a 
point when the political analysis CAI lessons had been revised to eliminate 
their most obvious faults, and when serious experimentation on alternative 
versions was beginning to be sensible, a budget crisis forced the university 
administration to announce, two weeks before the end of the semester, 
that the CAI laboratory would be abolished when the semester ended. 
CAI-dependent courses that had already been scheduled for the subse- 
quent semester, for which students had already pre-registered, had to be 
canceled or hurriedly revamped. The staff of the lab, told to prepare for 
dismissal within a few months, began trying to convert the most 
commonly used CAI procedures to reproduce the suddenly useless library 
of course materials for the new central campus computer, which hadn't 
even been installed yet, and about which little could be learned. At the 
time this book went to press, the outcome of this race against time was 
still unknown. Even if the hasty conversion succeeds and the new central 
computer provides a better basis for CAI than the small one in the lab (and 
in principle this ought to be the case), the experience will have reminded 
us that computer-assisted instruction, for all its advantages, is peculiarly 
vulnerable to shocks in the affairs of educational politics, finance, and 
technology. 

FOOTNOTE 

1. Bruce Arne Sherwood, The TUTOR Language (Urbana, III.: Compu- 
ter-based Education Research Laboratory, University of Illinois, 1974) 
pp. 1-8, 11-2. 
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APPENDIX 

Guide to Selected Continuing 
Sources of Information on CAI 

Betty Weneser 
Introduction 

This monograph will for the first lime provide political scientists with a 
helpful reference source about instructional uses of the computer 
specifically geared toward their interests. A search of the existing literature 
cwn computer-assisted instruction (CA!) reveals little information on 
applications to the teaching of political science, but a vast amount of 
material on CAI in other disciplines and in general. These include reviews 
of problems and accomplishments in CAI; analyses of trends and prospects 
for the future (already proven wrong in many cases); research reports on 
computer-based learning and instruction; and technical papers about 
hardware configurations, programming systems and languages relevant to 
CAI. One also learns that the literature in this new and fast developing 
field can become out of date very quickly. 

In this appendix, therefore, we will attempt to provide the reader not 
with a bibliography of currently relevant literature, but rather with 
some sources of information which may be useful and remain current for a 
longer period of time. We hope that in this way the serviceable life of this 
volume can be extended and that the reader will have a means for keeping 
up with new information in the future. 

Guide to Sources 

Preface 

A limited number of references have appeared In footnotes throughout 
this monograph. Additional books and journal articles can be found via the 
usual routes; to help, some specialized bibliographies are listed in the last 
section of this appendix. Most of this guide, however, will deal with 
sources not so readily available to the new or casual investigator. These 
should be particularly useful to those who wish to get started in doing 
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something but do not have an active CAI group at their institutions. 
The sources of information provided here will lead the reader to others. 
For example, attendance at a meeting of one of the more active societies 
will provide sources of information difficult to obtain in other ways; 
relevant conference and workshop calendars are included in several of the 
journals and newsletters cited. Information on costs of materials and their 
availability, subscription rates, and organization membership is omitted 
here because these data do not remain constant. Current addresses of the 
sources are given; though these may also change, they should help to 
locate information when needed. 

Professional Organizations and Journals 

Developments in CA! come f.'*om people with diverse backgrounds and 
expertise. As a result, their published works have appeared in a wide 
variety of journals (and often only in internal reports), and their papers 
delivered at conferences of assorted organizations. Attempts to gain more 
consistent forums have been made and are still in progress. Some of the 
orgar i/ations and journals which are most likely to offer information on 
instructional uses of the computer are cited In this section. 

Association for the Development of Computer-based Instructional 
Systems (ADCIS), formerly called Association for the Development of 
Instructional Systems (ADIS), is an international organization whose 
purposes are to "1 ) advance the investigation and utilization of computer- 
based instruction (CAI) and/or management (CMI); 2) promote and 
facilitate the interchange of information, programs and materials in the 
best professional and scientific tradition; 3) reduce redundant effort 
among developers; and 4) . . . specify requirements and priorities for 
hardware and software development, and encourage and facilitate their 
realization." 

Although the organization was begun (in 1967) by a small group of 
users of a common computing system, it has grown into the CAI 
professional society, catering to a membership with an ever-widening range 
of interests in the use of computers for instructional purposes. 

ADCIS sponsors semi-annual conferences (soon to be changed to 
annual), and publishes a bimonthly Newsletter, which contains informal 
reports of activities of member organizations, information about relevant 
conferences, and other timely news, and the quarterly lournal of 
Computer-Based Instruction (JCBI). JCBI, published since August 1974, is 
intended to be a scholarly journal serving the interests of ADCIS members. 

At this time there is no permanent office of ADCIS. The current 
president is Dr. G. Ronald Christopher, Airforce Institute of Technology, 
1230 Rona Parkway, Fairborn, Ohio 45234; the current secretary- 
treasurer is Dr. Peter M. Dean, IBM Corp., P.O. Box 70189, Los Angeles, 
aiif. 90070. 
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Association for Computing Machinery (ACM), with national head- 
quarters at 1133 Avenue of the Americas, Now York, N.Y. 10036, is a 
professional organization dedicated to the further development of the 
discipline of information processing and to the responsible use of 
computers in a wide variety of applications. 

Occasional articles concerning instructional uses of computers appear in 
the monthly publication. Communications of the ACM, less often in the 
quarterly Journa/ of the ACM. Computing Reviews at times contain 
abstracts and reviews of books and papers on CAI (note their Compre- 
hensive Annotated Bibliography on Computer Assisted Instruction cited in 
the section below on "Bibliographies"). 

More than 30 Special Interest Groups (SIGs), with membership not 
restricted to ACM membership, provide contacts and information geared 
to more specific interests, via their individual bulletins and special sessions 
at ACM and other conferences. Of particular interest is the group on 
Computer Uses in Education, SIGCUE. Its quarterly bulletin, Interface, 
includes news items of activities of this and related groups. The following 
groups may also be of interest to some readers: SIGSOC (Social & 
Behavioral Science Computing), bulletin issued quarterly; SIGCA5 (Com- 
puters and Society), newsletter issued quarterly; SIGSIM (Simulation), 
SIMULETTER issued quarterly; SIGPLAN/STAPL (Technical Committee 
on APL), bulletin issued quarterly. 

American Educational Research Association (AERA), 1201 16th 
Street, N.W., Washington, D.C. 20036, is a large professional organization 
for educational researchers. One of its eight divisions -Division C: 
Instruction and Learning-and the special interest group, SIGCAI (Compu- 
ter Aids to Instruction), often schedule sessions at the annual AERA 
meetings concerning instructional uses of computers. The quarterly 
publications, American Educational Research journal and Review of 
Educational Research, include papers on studies of computer-based 
education. 

EDUCOM, Interuniversity Communications Council, Inc., Box 364, 
Rosedale Road, Princeton, N.J. 08540, is a consortium of more than 100 
colleges, universities and non-profit organizations that serve higher 
education. Its purpose is to promote the effective use of computers and 
communications technology by sharing the combined expertise and 
facilities of its member organizations, by conducting appropriate studies 
and conferences, and by providing a center for information exchange. 

It publishes the quarterly EDUCOM bulletin, which frequently contains 
articles and news briefs concerning instructional uses of computers, often 
in the broader sense. For example, included in the Fall, 1975, issue (vol. 
10, No. 3) is an article by Sheilah R. Koeppen about a project aimed at the 
development, use and evaluation of computer-related teaching methods 
and instructional materials in political science. 
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Special Conferences and Symposia: A number of imporiani conferences 
are held under ihc auspices of other organi/.aiions; ihcir conference 
proceedings frequently contain interesting papers not always published 
elsewhere. 

The Conference on Computers in the University Curricula (CCUC), 
with partial support from NSF, has been held annually, at different 
locations, since 1970. It serves as a national forum for the study of 
computer use in undergraduate curricula. Information can be obtained 
from the CCUC Steering Committee, 124B Lindquist Center for Measure- 
men t, University of Iowa, Iowa City, Iowa 52242. 

The International Federation for Information Processing (IFIP) has 
sponsored two World Conferences on Computer Education, the first in 
1970 in Amsterdam, and the second in 1975 in Marseilles. Several 
publications were issued in connection with the 1970 conference. (See, for 
example, the van der Aa book listed below under "Bibliographies.") The 
proceedings of the more recent conference have been published in 
Computers in Education, edited by 0. Lecarmc and R. Lewis (New York: 
American Elsevier, 1975). 

The American Federation of Information Processing Societies (AFIPS) 
holds joint conferences with ACM and IEEE. The proc(?'edings of the 
"Spring Joint Conference" of 1972, vol. 40, contains many papers on 
computer-based instruction. 

Education Resources Information Center (ERIC), supported by the 
National Institute of Education, through its central office at NIE and a 
network of 16 clearinghouses located at universities and professional 
organizations throughout the country, each with responsibility for a 
particular educational area, acquires, evaluates, abstracts, indexes, and 
disseminates "the most significant and timely education-related reports." 
The clearinghouse most likely to review documents related to CAI is 
"Information Resources," a combination of the former two groups: 
"Educational Media and Technology" and "Libraries and Information 
Sciences." It is located at Stanford Center for Research and Development 
in Teaching, Stanford University, Stanford, Calif. 94305. The clearing- 
house on "Social Studies/Social Science Education," located at Social 
Sciences Education Consortium, Inc., 855 Broadway, Boulder, Colo. 
80302, may at times review reports on computer-based political science 
instruction if the focus is on course content. 

The two major ERIC publications, Resources in Education and Current 
Index to Journals in Education, are annotated in the section below on 
bibliographic guides. The clearinghouses. In addition to providing the 
entries for the two indexes, also prepare bibliographies and summary 
reports. (See, for example, The Best of ERIC under "Bibliographic 
Guides" below.) "Information Resources" Clearinghouse publishes a 
quarterly "ERIC at Stanford Ncv^<,\cncr/' Library/Media Report, available 
on request. 



132 



Appendix 131 



EducQtlonal Technology is a monihly publication of Educational 
Technology Publicailons, Inc., 140 Sylvan Avenue, Englewood Cliffs, N.j. 
07632, which also publishes books and monographs on educational uses of 
technology. Articles in many issues of the magazine deal with CAI--thc 
March, 1970, issue was entirely devoted to "The Computer and Educa- 
tion." The EducQtionol Technology Review Series, composed of collec- 
tions of articles on a single topic which have appeared in Educational 
Technology within the previous five years, covered 'The Computer and 
Education" in no. 9, January 1973. 

THE Journal (Technological Hori/ons in Education) is a new monthly 
magazine (charter issue was May 1974) published by Information Synergy, 
Inc., P.O. Box 992, Acton, Mass. 01720. It attempts to provide a forum' 
for the exchange of information by the educational and industrial 
communities. Included are articles concerning educators' experiences with 
the use of technology, calendars of pertinent conferences, information 
about and advertisements of technical products for education. For certain 
"qualified" readers the magazine is circulated free of charge, and in other 
ways resembles a trade journal. 

Datamation is a monthly magazine published by Technical Publishing 
Company, whose circulation office is at 35 Mason Street, Greenwich, 
Conn. 06830. Though it serves as a trade journal broadly covering the 
computer industry, articles and news reports on instructional applications 
are included at irregular intervals. The September, 1968, issue (Vol. 14, 
no. 9) was entirely devoted to "Computer Assisted Instruction." 

Institutional Publications: A number of universities and private and 
government organizations publish their own journals and bulletins which 
often contain information of interest to the CAI user or developer. For 
example. Viewpoints, the bimonthly bulletin of the School of Education, 
Indiana University, Bloomington, Indiana, devoted its July, 1974, issue 
(vol. 50, no. 4) to "Computer Assisted Instruction -Current Approaches 
and Trends." 

Information on Computer Equipment: There is no uniformity in the 
use of computer equipment or programming systems for instructional 
purposes at this time. Information about new developments in computer 
hardware and associated equipment (terminals, for example) is provided 
by some of the sources already cited; further information can be obtained 
from the equipment vendors, and the following additional sources are 
sometimes useful: 

Association for Educational Data Systems (AEDS), i201 16th Street, 
N.W., Washington, D.C. 20036, sponsors conventions featuring demonstra- 
tions of equipment and workshops on educational data processing. It 
publishes the magazine AEDS Monitor and the Journal of the Association 
of Educational Data Systems. 
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Computerworld is a "Ncwswcckly fcr ihc computer communiiy" 
published by Computerworld, Newton, Mass. 021 58. Both advertisements 
and articles in this trade newspaper provide Information on the state-of- 
the-art in hardware developments. 

Computer Decisions is a monthly trade magazine published by Hayden 
Publishing Company, New York. Hardware and software developments are 
included in the articles and advertisements. 

CAI Program Sources 

Personal contacts are useful for learning about and acquiring access to 
CAI programs, but often more formal approaches are needed. Institutions 
active in developing CAI programs usually prepare indices of their own 
"courseware" (e.g.. University of Illinois CERL report X41, "PLATO 
lV~Curriculum Materials," SUNY at Stony Brook's index "CAI Materials 
Available at SUNYSB," etc.). Computer manufacturers and users groups of 
common equipment also compile inventories of available programs. Three 
sources with broader scope are listed below. 

/ndex to Computer Based Learning^ to date the most comprehensive 
listing of CAI programs, is compiled by the Instructional Media Labora- 
tory, University of Wisconsin-Milwaukee, Milwaukee, Wise. 53201. The 
most recent edition (fourth), published in 1973 by Educational Tech- 
nology Publications, Inc., is presently being updated. Previous editions, 
since the first issue in 1969, were titled "Index to Computer Assisted 
Instruction." 

Formally annotated listings of CAI programs (the fourth edition 
contains 1766 entries) are organized by subject area (23 political science 
programs are listed). A useful appendix cross-references the programs by 
subject area, computer, programming language, instructional strategy, and 
source (institution where developed). 

CIRCUIT (Catalog of Instructional Resources for Computer Utilization 
in Teaching) is a more recently begun effort operated by SECOS (Shared 
Educational Computer Systems, Inc.), 420 Main Street, Poughkeepsie, 
N.Y. 12601. 

The catalog contains documentation for any program submitted to it, 
but CIRCUIT acts as a distribution center for programs written in only a 
limited set of languages (Coursewriter and APL). 

CONDUIT, a project supported by NSF and currently housed at the 
University of Iowa (P.O. Box 388, Iowa City, Iowa 52240), began as a 
consortium of five regional university computer centers to study the 
problems in transfer (between computer networks) of computer-based 
instructional materials and to seek ways of eliminating barriers to their 
dissemination. 

During this current fourth year of operation, CONDUIT is attempting 
to collect, evaluate, convert, maintain and distribute a limited group of 
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instructional packages for undergraduate education. Social sciences, one ol 
the areas of "courseware" being sought, has a review committee which 
includes a political scientist. Three times a year, CONDUIT publishes 
Pipe//ne, an informative report of its activities. 

Bibliographic Guides 

Knowledge of the specialized sources of information contained in the 
previous sections is not easily acquired via familiar routes. Guides to the 
published literature, however, are more generally known and available. In 
this section some special-purpose bibliographic sources are cited - 
cumulative guides to periodic literature in educational research and 
development, available in most libraries, and a few specialized bibliogra- 
phies. 

Cumulative Indexes: A number of standard cumulative indexes to the 
literature in education-related topics are generally available in libraries. 
Unfortunately, none of these is sufficiently comprehensive to eliminate 
the need for the others, and, indeed, many relevant documents do not 
appear in any or ihem. They can, however, serve a useful purpose, and 
three of the mort- helpful are cited here. 

Resources in Education, which before january, 1975, had the title 
Research in Education, is one of the two major compilations prepared by 
the Educational Resources Information Center (ERIC), the national 
information network listed previously in the section on professional 
organizations and journals. This guide indexes and abstracts "selected 
documents of educational significance," attempting particularly to cover 
unpublished technical and research reports, conference proceedings, etc. 
The abstracts are cross-referenced by subject, author, and institution. It is 
issued monthly; a cumulative index without abstracts is issued semi- 
annually. The change in the title to Resources in Education reflects a 
wider scope of materials reviewed than before. 

Current Index to journals in Education, the other major ERIC guide, is 
a monthly index to current "important educational periodic literature." 
Semiannual and annual cumulated indices are also issued. Articles selected 
from over 700 journals are cited, with brief annotations for most, and 
indexed by subject, author, and journal. 

The information collected for both of these ERIC indexes is also stored 
on magnetic tape in a computer-accessed data base; a topical key-word 
search (from a large set of descriptors, continually augmented) can very 
efficiently yield useful references. This facility is available in many 
libraries. 

Education Index is a cumulative author-subject index to "educational 
materials in the English language." It is published ten times a year by H.W. 
Wilson Company, Bronx, N.Y. 10452. In addition to periodicals, some 
conference proceedings, yearbooks, bulletins, monographs, and govern- 
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mcr publiciilions are included. Because the coverage of the education 
field is broad, and the list of publications reviewed for indexing is limited, 
this guide is not always strong on references to computer-based instruc- 
tion, 



Bibliographies: As previously noted, some of the journals and other 
documents which include articles of interest concerning instructional uses 
of computers are not indexed in the standard cumulative guides, Perhaps 
as a result of this, bibliographies of relevant articles and books appear at 
frequent intervals. A sample of some of these specialized bibliographies 
follows. 

Clark, Richard E. The Best of ERIC: Recent Trends In Computer Assisted 
Instruction, ERIC Clearinghouse on Media and Technology, April, 1973. 

This ERIC paper reviews trends in CAI through an annotated 
bibliography of relevant reports indexed in the ERIC system, arranged 
according to CAI problems dealt with. An updated version of this 
summary is in progress and is expected to be published by the 
"Information Resources" Clearinghouse at Stanford in August, 1976. 
An earlier summary was done In 1970 by Karl L. Zinn and Susan 
McClintock, "A Guide to the Literature on Interactive Use of 
Computers for Instruction," 2nd edn. 

Testerman, J. D., and Jackson, J. "Bibliography 33. A Comprehensive 
Annotated Bibliography on Computer Assisted Instruction," Computing 
Reviews, October and November, 1973. 

The articles, books and pamphlets included In this bibliography cover 
the period from 1967 to March, 1973. The annotated citations arc 
classified by topic. Computing Reviews Is a publication of ACM, listed 
in the section on professional organizations and journals. 

Barnes, O. Dennis, and Schriebcr, Deborah B. Computer-Assisted Instruc- 
tlon-A Selected Bibliography, Assn. for Educational Communications and 
Technology, Washington, March, 1972. 

Each citation is followed by a list of topical keywords selected from the 
content of the article. A keyword index and author index arc included. 

van dcr Aa, H. J., ct. al. (cds.). Computers and Education—An Inter- 
national Bibliography on Computers and Education, Science Associatcs- 
/Intcrnational, 1970. 

This "special publication on the occasion of the IFIP World Conference 
on Computer Education" is an annotated bibliography of books, 
articles, and bibliographies on education about computers as well as the 
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use of computers in education. It is a very good reference for those 
interested in pre-1970 documents. 

Stolurow, Lawrence M., and Peterson, Theodore I. Computers in Educa- 
tion -Selected Bibliography 1969-1972, IBM Application Bibliography. 

This bibliography lists journal articles and books alphabetically by 
author, uncatcgorized and without annotation. A list of journals 
referenced is included. 

Cantwell, Z. M., and Doyle, H. A. Instructional Technology: An 
Annotated Bibliography, Scarecrow Press, 1974. 

The major section of this book consists of a carefully annotated 
bibliography of selected journal articles, research reports and govern- 
ment documents published between 1969 and 1973 which report 
results of research studies in which use of some instructional tech- 
nology is made. Following this is a cross-referenced listing by category 
of instructional technology and student level, and, finally, an index, by 
discipline. 

Razik, T. A., and Ram roth, D. M. Bibliography of Research In 
Instructional /\1edla, Educational Technology Publications, 1974. 

The intent of the compilers of this bibliography, volume two of the 
Educational Technology* Bibliography Series, is to cover research 
reports in this broad field from 1915 to 1973. The entries are 
unannotated, but arc indexed by topic. Computer-assisted instruction, 
one of the topic headings, has i6 categories under ii. 

As a final note, a small collection with the curious title of Free and 
Inexpensive /[Materials on Computing in Teaching and Learning Activities, 
compiled by Karl L. Zinn, is available from the Center for Research on 
Learning and Teaching, 109 E. Madison, Ann Arbor, Michigan 
48104-singlc copy "free," multiple copies "inexpensive." 
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